00000001:02000400:1.0F:1787394809.844175:0:2959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787394828.585676:0:3180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787394830.372939:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 705 MB/s 00000001:01000000:2.0F:1787394830.623272:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 755 MB/s 00000001:01000000:2.0:1787394830.873544:0:3241:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5561 MB/s 00000020:02000000:2.0:1787394831.583237:0:3272:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_108_g575fb00 00000400:02000000:0.0:1787394832.867257:0:3287:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.116@tcp [8/256/0/180] 00008000:02000000:0.0:1787394836.722930:0:3437:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787394888.024040:0:5245:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787394896.220246:0:5783:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787394896.220253:0:5783:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787394896.220440:0:5783:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000095b379db 00000080:02000400:2.0:1787394896.220451:0:5783:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787394896.232073:0:5783:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787394896.232088:0:5783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0F:1787394896.233087:0:5783:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000147d9930) 00000020:00000080:3.0:1787394896.233126:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787394896.265156:0:5783:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787394896.265780:0:5783:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787394896.314822:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787394896.314864:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787394896.314888:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787394896.314944:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787394896.314973:0:5783:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787394896.320038:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787394896.320048:0:5783:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787394896.320060:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7c4e 00000020:01000004:2.0:1787394896.320070:0:5783:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787394896.320075:0:5783:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787394896.320079:0:5783:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000095b379db from MGS 00000020:01000004:2.0:1787394896.320083:0:5783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787394896.320113:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000001d98ffa) 00000020:00000080:2.0:1787394896.320126:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787394896.320199:0:5783:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000095b379db from MGS, refs=2 00080000:01000000:2.0:1787394896.320205:0:5783:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787394896.320211:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7c5c 00000100:00100000:2.0:1787394896.320647:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787394896.320758:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787394896.320764:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787394896.321259:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787394896.321276:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787394896.323158:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394896.323810:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787394896.323825:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787394896.324618:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787394896.324626:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787394896.325141:0:5783:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787394896.325148:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787394896.326067:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394896.326071:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394896.326073:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394896.326352:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394896.326355:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394896.326357:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394896.327113:0:5783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787394896.335879:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787394896.576432:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3527 MB/s 00000001:01000000:3.0:1787394896.826548:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4599 MB/s 00000001:01000000:1.0:1787394897.076717:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 607 MB/s 00000001:01000000:2.0:1787394897.326785:0:5783:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1119 MB/s 00080000:10000000:2.0:1787394897.331499:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787394897.340114:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787394897.340130:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787394897.340133:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787394897.346121:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787394897.346524:0:5783:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787394897.346589:0:5783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787394897.347289:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787394897.347349:0:5783:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787394897.347674:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787394897.348992:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787394897.349000:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787394897.351050:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787394897.351060:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787394897.351619:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787394897.351626:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787394897.352287:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787394897.352341:0:5783:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.116@tcp' 00000020:01000004:3.0:1787394897.352344:0:5783:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787394897.352389:0:5783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.116@tcp (typ=mgc) 00000020:00000080:3.0:1787394897.352401:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.116@tcp (00000000db7deb98) 00000020:00000080:3.0:1787394897.352417:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787394897.352491:0:5783:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000967b5d5@MGC192.168.203.116@tcp: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1787394897.352651:0:5783:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.116@tcp-0 is initialized 00000040:01000000:3.0:1787394897.352658:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787394897.354380:0:5798:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787394897.359560:0:5799:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787394897.359658:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.116@tcp (uuid 8581b891-0741-4f4a-b0af-8eaaf7ff17d5) 00000020:00000080:2.0:1787394897.359681:0:5783:0:(genops.c:1406:class_connect()) connect: client 8581b891-0741-4f4a-b0af-8eaaf7ff17d5, cookie 0xedbabbe2e89a7c6a 00000100:00080000:2.0:1787394897.359692:0:5783:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787394897.359697:0:5783:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import 000000000967b5d5 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787394897.359802:0:5783:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ca06cd4 x1874219323359360/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787394897.359937:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ca06cd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323359360:0@lo:250: 00000100:00100000:3.0:1787394897.360038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394897.360168:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323359360 00000100:00100000:0.0:1787394897.360175:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323359360 00000100:00100000:0.0:1787394897.360219:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394897.360226:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001383fcc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874219323359360:12345-0@lo:250: 00010000:00080000:0.0:1787394897.360248:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 8581b891-0741-4f4a-b0af-8eaaf7ff17d5@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1787394897.360287:0:5795:0:(genops.c:1406:class_connect()) connect: client 8581b891-0741-4f4a-b0af-8eaaf7ff17d5, cookie 0xedbabbe2e89a7c71 00000100:00080000:0.0:1787394897.360436:0:5795:0:(import.c:65:import_set_state_nolock()) 0000000063f91808 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787394897.360526:0:5783:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS 00000020:01000004:2.0:1787394897.360547:0:5783:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787394897.360568:0:5783:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787394897.360579:0:5783:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000001aeb8fa8) 00000020:00000080:2.0:1787394897.360588:0:5783:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787394897.364604:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001383fcc4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:3302:x1874219323359360:12345-0@lo:250: Request processed in 4369us (4559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394897.364618:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394897.365186:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787394897.365198:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:3.0:1787394897.365208:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787394897.365213:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787394897.365218:0:3302:0:(import.c:65:import_set_state_nolock()) 000000000967b5d5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787394897.365221:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787394897.365438:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787394897.365447:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ca06cd4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323359360:0@lo:250: 00010000:00010000:1.0:1787394897.367366:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394897.378476:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394897.378661:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787394897.378667:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787394897.385503:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787394897.385518:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787394897.389958:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787394897.389976:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787394897.391059:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394897.391251:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787394897.391266:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787394897.391994:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787394897.392001:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787394897.438540:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787394897.438771:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787394897.438778:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787394897.441574:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787394897.442033:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787394897.443709:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787394897.443888:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787394897.443894:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787394897.447545:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787394897.447559:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787394897.448189:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394897.448450:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787394897.448455:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787394897.455733:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787394897.455749:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787394897.456599:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394897.456924:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787394897.456931:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787394897.457500:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787394897.457515:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787394897.483977:0:5783:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787394897.484966:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787394897.484973:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787394897.486285:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787394897.486404:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787394897.487938:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787394897.487952:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787394897.488675:0:5783:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787394897.488698:0:5783:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787394897.488704:0:5783:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787394897.488824:0:5783:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787394897.488857:0:5783:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787394897.488862:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787394897.488863:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394897.488864:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394897.488866:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394897.488867:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394897.488868:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394897.488869:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394897.488871:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394897.488872:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394897.488873:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394897.488875:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394897.488876:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787394897.488878:0:5783:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787394897.488881:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787394897.488882:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394897.488888:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394897.488889:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394897.488890:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394897.488891:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394897.488892:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394897.488893:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394897.488894:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394897.488895:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394897.488896:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394897.488897:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787394897.488931:0:5783:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787394897.488948:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992615a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359488:0@lo:253: 00000100:00100000:1.0:1787394897.489032:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394897.489085:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8acf68c going to sleep for 11 seconds 00000100:00100000:2.0:1787394897.489144:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323359488 00000100:00100000:2.0:1787394897.489152:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323359488 00000100:00100000:2.0:1787394897.489196:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787394897.489203:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccbbbcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:5783:x1874219323359488:12345-0@lo:253: 20000000:01000000:2.0:1787394897.489244:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787394897.489247:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787394897.489665:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787394897.489715:0:5797:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787394897.489965:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787394897.491189:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787394897.491540:0:5797:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787394897.491544:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787394897.491549:0:5797:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787394897.491552:0:5797:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787394897.491566:0:5797:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787394897.491765:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394897.492010:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787394897.492024:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787394897.492149:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787394897.492204:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787394897.492242:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787394897.492395:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787394897.492405:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787394897.492468:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787394897.492477:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787394897.492510:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787394897.492518:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787394897.492549:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787394897.492599:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787394897.492637:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787394897.492643:0:5797:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787394897.492657:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394897.492864:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787394897.492874:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787394897.492912:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787394897.492945:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787394897.492993:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787394897.493005:0:5797:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787394897.493097:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787394897.493104:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787394897.493151:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787394897.493189:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787394897.493222:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787394897.493233:0:5797:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787394897.493357:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787394897.493367:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787394897.493398:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787394897.493433:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787394897.493579:0:5797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787394897.493625:0:5797:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787394897.493632:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787394897.494665:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787394897.494966:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787394897.494988:0:5797:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.116@tcp for mdt 20000000:01000000:1.0:1787394897.494990:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.116@tcp (null) (null) (null) 00000040:00080000:1.0:1787394897.495168:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787394897.495178:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787394897.495212:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787394897.495220:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.116@tcp (null) (null) 00000040:00080000:1.0:1787394897.495274:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787394897.495285:0:5797:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787394897.495548:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787394897.495594:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787394897.495667:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787394897.495670:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787394897.495676:0:5797:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787394897.495682:0:5797:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787394897.496016:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1787394897.496289:0:5797:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787394897.507195:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787394897.507262:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787394897.507487:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787394897.507508:0:5797:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787394897.507511:0:5797:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787394897.507515:0:5797:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787394897.507526:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787394897.507528:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787394897.507556:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787394897.507559:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787394897.508000:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1787394897.508375:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1787394897.508417:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1787394897.508478:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1787394897.508493:0:5797:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787394897.508495:0:5797:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787394897.509019:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787394897.509406:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787394897.509458:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787394897.509502:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787394897.509515:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787394897.509517:0:5797:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1787394897.509523:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787394897.509545:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509561:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509571:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509577:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509583:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509589:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509595:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000209ffb4 already unused, calling callback (00000000ab881f7e) 00010000:00010000:3.0:1787394897.509606:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509613:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509624:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509631:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.509636:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c7f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787394897.509654:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787394897.719730:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccbbbcc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:5783:x1874219323359488:12345-0@lo:253: Request processed in 230521us (230692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394897.719730:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992615a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359488:0@lo:253: 00000100:00100000:3.0:1787394897.719749:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1787394897.719749:0:5783:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787394897.719752:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787394897.719753:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394897.719755:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394897.719756:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787394897.719757:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394897.719758:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394897.719759:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394897.719760:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394897.719762:0:5783:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787394897.719763:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394897.719764:0:5783:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787394897.719794:0:5783:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000095b379db from lustre-MDT0000 10000000:01000000:1.0:1787394897.719817:0:5783:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787394897.719821:0:5783:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787394897.719825:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0b3181099c0 10000000:01000000:1.0:1787394897.719829:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787394897.719836:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0b3181099c0 from 1 10000000:01000000:1.0:1787394897.719838:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787394897.719868:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394897.719877:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394897.719885:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394897.719900:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000992615a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359616:0@lo:101: 00000100:00100000:1.0:1787394897.719934:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394897.719989:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000004123ee57 going to sleep for 11 seconds 00000100:00100000:3.0:1787394897.720049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323359616 00000100:00100000:3.0:1787394897.720056:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323359616 00000100:00100000:3.0:1787394897.720102:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787394897.720113:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e9fbefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:5783:x1874219323359616:12345-0@lo:101: 00010000:00010000:3.0:1787394897.720133:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394897.720144:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7c86 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.720164:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.720173:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000209ffb4/0xedbabbe2e89a7c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.720201:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000209ffb4, rc 0) 00000100:00100000:3.0:1787394897.720239:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e9fbefc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5783:x1874219323359616:12345-0@lo:101: Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394897.720245:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787394897.720478:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000992615a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359616:0@lo:101: 00010000:00010000:0.0:1787394897.720491:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.720498:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394897.720558:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359744:0@lo:501: 00000100:00100000:0.0:1787394897.720586:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394897.720607:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323359744 00000100:00100000:0.0:1787394897.720607:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d995edbe going to sleep for 11 seconds 00000100:00100000:3.0:1787394897.720611:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323359744 00000100:00100000:3.0:1787394897.720626:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787394897.720631:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000095eb107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5783:x1874219323359744:12345-0@lo:501: 00000100:00100000:3.0:1787394897.720886:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000095eb107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5783:x1874219323359744:12345-0@lo:501: Request processed in 254us (299us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787394897.720893:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787394897.720998:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359744:0@lo:501: 10000000:01000000:0.0:1787394897.721019:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787394897.721036:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721044:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 00000000209be7b9/0xedbabbe2e89a7c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394897.721052:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b318a89000 10000000:01000000:0.0:1787394897.721056:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787394897.721059:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0b318a89000 10000000:01000000:0.0:1787394897.721061:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787394897.721064:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0b318a89000 from 1 10000000:01000000:0.0:1787394897.721066:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787394897.721084:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721242:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721425:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394897.721440:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359872:0@lo:101: 00000100:00100000:0.0:1787394897.721468:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394897.721558:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d995edbe going to sleep for 11 seconds 00000100:00100000:2.0:1787394897.721635:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323359872 00000100:00100000:2.0:1787394897.721639:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323359872 00000100:00100000:2.0:1787394897.721674:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787394897.721681:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042303535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5783:x1874219323359872:12345-0@lo:101: 00010000:00010000:2.0:1787394897.721689:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394897.721706:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004248c797/0xedbabbe2e89a7c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7c94 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394897.721722:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004248c797/0xedbabbe2e89a7c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7c94 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394897.721731:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004248c797/0xedbabbe2e89a7c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7c94 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394897.721739:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004248c797, rc 0) 00000100:00100000:2.0:1787394897.721791:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042303535 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:5783:x1874219323359872:12345-0@lo:101: Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394897.721801:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787394897.721828:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323359872:0@lo:101: 00010000:00010000:0.0:1787394897.721839:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721847:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394897.721858:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787394897.721870:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721876:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 000000009a40f4d5/0xedbabbe2e89a7c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394897.721882:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787394897.721886:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787394897.721891:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0b318a89000 10000000:01000000:0.0:1787394897.721893:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787394897.721897:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787394897.721899:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787394897.721910:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721921:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.721928:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394897.721939:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360000:0@lo:101: 00000100:00100000:0.0:1787394897.721963:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394897.722029:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360000 00000100:00100000:0.0:1787394897.722032:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d995edbe going to sleep for 11 seconds 00000100:00100000:3.0:1787394897.722072:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360000 00000100:00100000:3.0:1787394897.722108:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787394897.722115:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6e5ec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:5783:x1874219323360000:12345-0@lo:101: 00010000:00010000:3.0:1787394897.722120:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394897.722132:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa585a4f/0xedbabbe2e89a7ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7ca2 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.722141:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa585a4f/0xedbabbe2e89a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.722146:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa585a4f/0xedbabbe2e89a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394897.722150:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa585a4f, rc 0) 00000100:00100000:3.0:1787394897.722181:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6e5ec8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+8:5783:x1874219323360000:12345-0@lo:101: Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394897.722190:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787394897.722459:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360000:0@lo:101: 00010000:00010000:0.0:1787394897.722482:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394897.722489:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394897.722530:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360128:0@lo:501: 00000100:00100000:0.0:1787394897.722556:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394897.722584:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d995edbe going to sleep for 11 seconds 00000100:00100000:2.0:1787394897.722750:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360128 00000100:00100000:2.0:1787394897.722755:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360128 00000100:00100000:2.0:1787394897.722787:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787394897.722800:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094604f37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+8:5783:x1874219323360128:12345-0@lo:501: 00000100:00100000:2.0:1787394897.723017:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094604f37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5783:x1874219323360128:12345-0@lo:501: Request processed in 217us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394897.723024:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787394897.723208:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360128:0@lo:501: 00000100:00100000:0.0:1787394897.723245:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360256:0@lo:503: 00000100:00100000:0.0:1787394897.723438:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394897.723457:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d995edbe going to sleep for 11 seconds 00000100:00100000:1.0:1787394897.723584:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360256 00000100:00100000:1.0:1787394897.723595:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360256 00000100:00100000:1.0:1787394897.723731:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787394897.723739:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd54231d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5783:x1874219323360256:12345-0@lo:503: 00000100:00100000:1.0:1787394897.723903:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd54231d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5783:x1874219323360256:12345-0@lo:503: Request processed in 165us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394897.723909:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787394897.723984:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360256:0@lo:503: 00000100:00100000:2.0:1787394897.724660:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008d455e25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5826:1874219323360384:0@lo:502: 00000100:00100000:2.0:1787394897.724706:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394897.724743:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 0000000015e60023 going to sleep for 11 seconds 00000100:00100000:1.0:1787394897.724816:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360384 00000100:00100000:1.0:1787394897.724824:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360384 00000100:00100000:1.0:1787394897.724855:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787394897.724861:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048d8a2db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5826:x1874219323360384:12345-0@lo:502: 00000100:00100000:1.0:1787394897.725038:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048d8a2db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5826:x1874219323360384:12345-0@lo:502: Request processed in 177us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394897.725045:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787394897.725225:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008d455e25 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5826:1874219323360384:0@lo:502: 00000020:01000000:0.0:1787394897.725265:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787394897.725275:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394897.725278:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787394897.725282:0:5826:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787394897.725285:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787394897.725328:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000076cff909) 00000020:00000080:0.0:1787394897.725348:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787394897.725355:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787394897.725466:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787394897.725483:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7cb7 00000020:00000080:0.0:1787394897.725711:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787394897.725716:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787394897.725719:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394897.725721:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787394897.725723:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787394897.725727:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394897.725728:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787394897.725731:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787394897.725737:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005402b57d) 00000020:00000080:0.0:1787394897.725746:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787394897.725749:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787394897.725751:0:5826:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787394897.725753:0:5826:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787394897.725758:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787394897.725798:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000095b379db from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787394897.725808:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000089a1661b) 00000020:00000080:0.0:1787394897.725814:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787394897.725879:0:5826:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787394897.725885:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a7ccc 00000020:00000080:0.0:1787394897.725999:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787394897.726005:0:5826:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787394897.726010:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xedbabbe2e89a7cd3 00080000:01000000:0.0:1787394897.726014:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787394897.726022:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7cda 00080000:10000000:0.0:1787394897.726424:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787394897.726647:0:5826:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787394897.732283:0:5826:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787394897.829627:0:5826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787394897.830449:0:5826:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787394897.837181:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787394897.837552:0:5826:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787394897.882502:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006c4eef80) 00000020:00000080:0.0:1787394897.882524:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787394897.882612:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787394897.882619:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7ce8 00000020:00000080:3.0:1787394897.890436:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787394897.891955:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787394897.951998:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394897.989959:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394898.027187:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394898.069720:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787394898.110656:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787394898.138148:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xedbabbe2e89a7cef 00000020:00000080:0.0:1787394898.138825:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787394898.138837:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787394898.138843:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394898.138845:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787394898.138848:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787394898.138853:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394898.138854:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787394898.138858:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787394898.138896:0:5826:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787394898.138917:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787394898.138920:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394898.138922:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787394898.138924:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787394898.138926:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394898.138928:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787394898.138930:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787394898.138932:0:5826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787394898.138971:0:5826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5826:1874219323360512:0@lo:502: 00000100:00100000:0.0:1787394898.139054:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.139123:0:5826:0:(client.c:2702:ptlrpc_set_wait()) set 00000000de35fbe6 going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.139231:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360512 00000100:00100000:3.0:1787394898.139238:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360512 00000100:00100000:3.0:1787394898.139301:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787394898.139334:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d1db5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5826:x1874219323360512:12345-0@lo:502: 00000100:00100000:3.0:1787394898.139718:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d1db5b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5826:x1874219323360512:12345-0@lo:502: Request processed in 385us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394898.139726:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787394898.140137:0:5826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5826:1874219323360512:0@lo:502: 00000020:01000000:0.0:1787394898.140165:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787394898.140177:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394898.140179:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787394898.140183:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787394898.140405:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787394898.140422:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787394898.140436:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.140447:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 0000000099e6353a/0xedbabbe2e89a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394898.140454:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b318a89000 from 1 10000000:01000000:1.0:1787394898.140457:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787394898.140485:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.140491:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.140513:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394898.140528:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360640:0@lo:101: 00000100:00100000:1.0:1787394898.140565:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394898.140602:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4e7ed28 going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.140710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360640 00000100:00100000:3.0:1787394898.140716:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360640 00000100:00100000:3.0:1787394898.140752:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787394898.140759:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed593cc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:5783:x1874219323360640:12345-0@lo:101: 00010000:00010000:3.0:1787394898.140769:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394898.140781:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7cf6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.140800:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.140809:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.140818:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001aae9bc, rc 0) 00000100:00100000:3.0:1787394898.140848:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed593cc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:5783:x1874219323360640:12345-0@lo:101: Request processed in 90us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394898.140866:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787394898.141031:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360640:0@lo:101: 00010000:00010000:1.0:1787394898.141043:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.141051:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394898.141774:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360768:0@lo:256: 00000100:00100000:1.0:1787394898.141819:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394898.141841:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4e7ed28 going to sleep for 11 seconds 00000100:00100000:1.0:1787394898.141862:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360768 00000100:00100000:1.0:1787394898.141867:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360768 00000100:00100000:1.0:1787394898.141955:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787394898.141962:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f4d12d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:5783:x1874219323360768:12345-0@lo:256: 20000000:01000000:1.0:1787394898.141979:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787394898.141985:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787394898.142050:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f4d12d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:5783:x1874219323360768:12345-0@lo:256: Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394898.142056:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787394898.142240:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360768:0@lo:256: 10000000:01000000:1.0:1787394898.142983:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787394898.143006:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143016:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394898.143023:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b318a89000 from 1 10000000:01000000:1.0:1787394898.143026:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787394898.143053:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143060:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143068:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394898.143083:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360896:0@lo:101: 00000100:00100000:1.0:1787394898.143181:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394898.143218:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f4e7ed28 going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.143288:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323360896 00000100:00100000:3.0:1787394898.143294:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323360896 00000100:00100000:1.0:1787394898.143454:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394898.143463:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005290f49d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:5783:x1874219323360896:12345-0@lo:101: 00010000:00010000:1.0:1787394898.143474:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394898.143492:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d04 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143512:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143531:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.143538:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5290dca, rc 0) 00000100:00100000:1.0:1787394898.143626:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005290f49d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323360896:12345-0@lo:101: Request processed in 164us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394898.143632:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787394898.143699:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007515230c pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323360896:0@lo:101: 00010000:00010000:2.0:1787394898.143710:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394898.143717:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394898.143765:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361024:0@lo:501: 00000100:00100000:2.0:1787394898.143791:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394898.143814:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000003be4e9ef going to sleep for 11 seconds 00000100:00100000:0.0:1787394898.143895:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361024 00000100:00100000:0.0:1787394898.143902:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361024 00000100:00100000:0.0:1787394898.143936:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787394898.143942:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003590c25b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323361024:12345-0@lo:501: 00000100:00100000:0.0:1787394898.144720:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003590c25b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323361024:12345-0@lo:501: Request processed in 777us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394898.144729:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787394898.144759:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361024:0@lo:501: 00000100:00100000:2.0:1787394898.144789:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361152:0@lo:503: 00000100:00100000:2.0:1787394898.145155:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394898.145192:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000003be4e9ef going to sleep for 11 seconds 00000100:00100000:1.0:1787394898.145281:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361152 00000100:00100000:1.0:1787394898.145287:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361152 00000100:00100000:1.0:1787394898.145347:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394898.145354:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bb170b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323361152:12345-0@lo:503: 00000040:00080000:1.0:1787394898.145394:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787394898.145454:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bb170b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323361152:12345-0@lo:503: Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394898.145461:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787394898.145598:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361152:0@lo:503: 00000040:00080000:2.0:1787394898.147184:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1787394898.147585:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1787394898.147607:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787394898.147660:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.147673:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394898.147769:0:5783:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787394898.147773:0:5783:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b318a89000 10000000:01000000:0.0:1787394898.147776:0:5783:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b318a89000 10000000:01000000:0.0:1787394898.147780:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787394898.147786:0:5783:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b318a89000 from 1 10000000:01000000:0.0:1787394898.147789:0:5783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787394898.147821:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394898.147841:0:5783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394898.147852:0:5783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394898.147875:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361280:0@lo:101: 00000100:00100000:0.0:1787394898.147936:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.148012:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b66e8eed going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.148082:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361280 00000100:00100000:3.0:1787394898.148151:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361280 00000100:00100000:3.0:1787394898.148235:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787394898.148245:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e9df1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323361280:12345-0@lo:101: 00010000:00010000:3.0:1787394898.148269:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394898.148283:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068845029/0xedbabbe2e89a7d19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d12 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.148330:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068845029/0xedbabbe2e89a7d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.148340:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068845029/0xedbabbe2e89a7d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.148349:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068845029, rc 0) 00000100:00100000:3.0:1787394898.148465:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e9df1a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323361280:12345-0@lo:101: Request processed in 222us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394898.148473:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787394898.148554:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361280:0@lo:101: 00010000:00010000:0.0:1787394898.148567:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394898.148587:0:5783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394898.148635:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361408:0@lo:501: 00000100:00100000:0.0:1787394898.148662:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.149008:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b66e8eed going to sleep for 11 seconds 00000100:00100000:2.0:1787394898.149069:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361408 00000100:00100000:2.0:1787394898.149074:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361408 00000100:00100000:2.0:1787394898.149169:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787394898.149176:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec59cbb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323361408:12345-0@lo:501: 00000100:00100000:2.0:1787394898.149624:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec59cbb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323361408:12345-0@lo:501: Request processed in 448us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394898.149631:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787394898.149757:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361408:0@lo:501: 00000100:00100000:0.0:1787394898.149786:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361536:0@lo:503: 00000100:00100000:0.0:1787394898.149821:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.149906:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b66e8eed going to sleep for 11 seconds 00000100:00100000:2.0:1787394898.149942:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361536 00000100:00100000:2.0:1787394898.149946:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361536 00000100:00100000:2.0:1787394898.150010:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787394898.150015:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4197b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323361536:12345-0@lo:503: 00000100:00100000:2.0:1787394898.150340:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4197b76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323361536:12345-0@lo:503: Request processed in 324us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394898.150346:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787394898.150429:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323361536:0@lo:503: 00000100:00100000:2.0:1787394898.151206:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5831:1874219323361664:0@lo:502: 00000100:00100000:2.0:1787394898.151265:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.151544:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set 0000000023761552 going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.151597:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361664 00000100:00100000:3.0:1787394898.151603:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361664 00000100:00100000:3.0:1787394898.151669:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787394898.151676:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a776ecf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5831:x1874219323361664:12345-0@lo:502: 00000100:00100000:3.0:1787394898.152022:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a776ecf5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5831:x1874219323361664:12345-0@lo:502: Request processed in 346us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394898.152031:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787394898.152128:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099bad03b pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5831:1874219323361664:0@lo:502: 00000020:01000004:1.0:1787394898.152182:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787394898.152206:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005abff4a1) 00000020:00000080:1.0:1787394898.152223:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787394898.153873:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000095b379db from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787394898.153883:0:5831:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000095b379db from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787394898.153885:0:5831:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000095b379db 4 00010000:00080000:1.0:1787394898.153916:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006c8f300a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787394898.158979:0:5831:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787394898.159079:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787394898.159190:0:5831:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787394898.159204:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xedbabbe2e89a7d27 00000100:00080000:1.0:1787394898.159213:0:5831:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787394898.159218:0:5831:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006c8f300a using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787394898.159264:0:5831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b85ce223 x1874219323361792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787394898.159352:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b85ce223 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323361792:0@lo:38: 00000100:00100000:3.0:1787394898.159581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.159674:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361792 00000100:00100000:0.0:1787394898.159681:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361792 00000100:00100000:0.0:1787394898.159715:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394898.159721:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f395912f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323361792:12345-0@lo:38: 00000100:00080000:1.0:1787394898.159799:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787394898.162879:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f395912f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323361792:12345-0@lo:38: Request processed in 3147us (3289us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787394898.162894:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394898.163324:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787394898.163333:0:3302:0:(import.c:65:import_set_state_nolock()) 000000006c8f300a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787394898.163338:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787394898.163342:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b85ce223 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323361792:0@lo:38: 00000100:00100000:0.0:1787394898.164193:0:5831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5831:1874219323361920:0@lo:502: 00000100:00100000:0.0:1787394898.164277:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394898.164342:0:5831:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b66e8eed going to sleep for 11 seconds 00000100:00100000:1.0:1787394898.164358:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323361920 00000100:00100000:1.0:1787394898.164366:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323361920 00000100:00100000:1.0:1787394898.164511:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787394898.164519:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b332e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5831:x1874219323361920:12345-0@lo:502: 00000100:00100000:1.0:1787394898.164727:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b332e45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5831:x1874219323361920:12345-0@lo:502: Request processed in 209us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394898.164735:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787394898.166857:0:5831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000dbd54ecd pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5831:1874219323361920:0@lo:502: 00000040:00080000:0.0:1787394898.166906:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787394898.167069:0:5783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787394898.167099:0:5783:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787394898.167116:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.167126:0:5783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 0000000073123e8e/0xedbabbe2e89a7d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787394898.167185:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787394898.167190:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394898.167192:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394898.167193:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394898.167194:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394898.167195:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394898.167196:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394898.167197:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394898.167198:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394898.167199:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394898.167201:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394898.167201:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394898.167204:0:5783:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787394898.167206:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787394898.167208:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394898.167208:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394898.167209:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394898.167210:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394898.167211:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394898.167212:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394898.167213:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394898.167213:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394898.167214:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394898.167215:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394898.167216:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394898.167236:0:5783:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787394898.167257:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036056ad0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323362048:0@lo:253: 00000100:00100000:1.0:1787394898.167329:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394898.167360:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set 000000007733e501 going to sleep for 11 seconds 00000100:00100000:3.0:1787394898.167574:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362048 00000100:00100000:3.0:1787394898.167581:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362048 00000100:00100000:3.0:1787394898.167636:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787394898.167643:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f437b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5783:x1874219323362048:12345-0@lo:253: 20000000:01000000:3.0:1787394898.167665:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787394898.167678:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787394898.214301:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787394898.214349:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787394898.214455:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787394898.214460:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787394898.214478:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.214498:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.214506:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.214549:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.214563:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 12 pid: 5795 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394898.214577:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001226e0f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323362176:0@lo:104: 00000100:00100000:1.0:1787394898.214636:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394898.214696:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d8acf68c going to sleep for 11 seconds 00000100:00100000:2.0:1787394898.214767:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362176 00000100:00100000:2.0:1787394898.214775:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362176 00000100:00100000:2.0:1787394898.214826:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787394898.214834:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e0440a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323362176:12345-0@lo:104: 00010000:00010000:2.0:1787394898.214846:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394898.214918:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787394898.214923:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e0440a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323362176:12345-0@lo:104: Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394898.214931:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394898.214960:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001226e0f0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323362176:0@lo:104: 00010000:00010000:0.0:1787394898.214978:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215025:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787394898.215031:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215039:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000083aba433 already unused, calling callback (00000000ea2b7585) 10000000:00010000:3.0:1787394898.215043:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215051:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394898.215058:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394898.215064:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394898.215190:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215208:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787394898.215299:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c1d670a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323362304:0@lo:103: 00000100:00100000:0.0:1787394898.215354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394898.215543:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215551:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: 0000000083aba433/0xedbabbe2e89a7cf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7cfd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394898.215571:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394898.215572:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394898.215574:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394898.216143:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362304 00000100:00100000:1.0:1787394898.216150:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362304 00010000:00010000:1.0:1787394898.216172:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 13 pid: 5795 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394898.216205:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787394898.216212:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbd54ecd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3304:x1874219323362304:12345-0@lo:103: 00010000:00010000:1.0:1787394898.216227:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394898.216232:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 13 pid: 5795 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216241:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 13 pid: 5795 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216266:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000001aae9bc/0xedbabbe2e89a7cfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7cf6 expref: 13 pid: 5795 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216279:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216298:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787394898.216357:0:5787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001897292s 00010000:00010000:1.0:1787394898.216361:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216368:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216373:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216380:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216385:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021fa8c72 already unused, calling callback (00000000ab881f7e) 00010000:00010000:1.0:1787394898.216388:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216394:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216413:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394898.216422:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394898.216465:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbd54ecd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3304:x1874219323362304:12345-0@lo:103: Request processed in 254us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394898.216473:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787394898.216514:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c1d670a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323362304:0@lo:103: 00010000:00010000:0.0:1787394898.216546:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394898.216556:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394898.216561:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021fa8c72/0xedbabbe2e89a7d2e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394898.237162:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f437b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5783:x1874219323362048:12345-0@lo:253: Request processed in 69512us (69825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394898.237179:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787394898.237542:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036056ad0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5783:1874219323362048:0@lo:253: 10000000:01000000:1.0:1787394898.237559:0:5783:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787394898.237563:0:5783:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787394898.237565:0:5783:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787394898.237566:0:5783:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394898.237567:0:5783:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394898.237568:0:5783:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394898.237570:0:5783:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394898.237572:0:5783:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787394898.237573:0:5783:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787394898.237575:0:5783:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394898.237576:0:5783:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394898.237578:0:5783:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394898.237579:0:5783:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787394898.237595:0:5783:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787394898.251706:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394898.254246:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787394898.255204:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394898.255450:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787394898.255945:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787394898.256129:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787394898.262635:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787394898.262977:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787394898.266986:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787394898.272987:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787394898.276760:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787394898.279043:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787394898.370045:0:5783:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1787394898.388375:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787394898.433209:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787394898.433604:0:5837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787394898.436055:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787394898.436261:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787394898.436734:0:5783:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787394898.436744:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787394898.436880:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787394898.439683:0:5836:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787394898.439692:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1787394898.451410:0:5783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787394898.462897:0:5783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787394898.462966:0:5783:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787394898.463552:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787394898.463897:0:5783:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787394898.466455:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787394898.466620:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787394898.466760:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787394898.466899:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787394898.467052:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787394898.467796:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787394898.467955:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787394898.468831:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787394898.468982:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787394898.472735:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787394898.472933:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787394898.475511:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787394898.475742:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787394898.475895:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787394898.476292:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787394898.476496:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787394898.476782:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787394898.476935:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787394898.478286:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787394898.478542:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787394898.478704:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787394898.478895:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787394898.479084:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787394898.479241:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787394898.479433:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787394898.479587:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787394898.479721:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787394898.479871:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787394898.480022:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787394898.480181:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787394898.484583:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787394898.487154:0:5783:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787394898.487405:0:5783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1787394898.564007:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787394898.674455:0:5783:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787394898.674498:0:5783:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba80c1ca7988 00100000:10000000:2.0:1787394898.674506:0:5783:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787394898.677612:0:5783:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787394898.677634:0:5783:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787394898.677648:0:5783:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787394898.677665:0:5783:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787394898.740112:0:5837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787394898.740188:0:5837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787394898.740192:0:5837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787394899.416234:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394900.442228:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394901.458494:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394902.487154:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787394903.325174:0:6080:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787394903.523075:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394903.634827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007fd883b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323362432:0@lo:400: 00000100:00100000:3.0:1787394903.634899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394903.635428:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362432 00000100:00100000:2.0:1787394903.635438:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362432 00000100:00100000:1.0:1787394903.635749:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787394903.635758:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031731c2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3305:x1874219323362432:12345-0@lo:400: 00000100:00080000:0.0:1787394903.635851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787394903.635869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787394903.635872:0:37:0:(import.c:65:import_set_state_nolock()) 000000006c8f300a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787394903.635896:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006c8f300a using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787394903.635919:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e14d4cab x1874219323362560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787394903.636276:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e14d4cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323362560:0@lo:38: 00000100:00100000:0.0:1787394903.640001:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007fd883b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323362432:0@lo:400: 00000100:00100000:1.0:1787394903.640086:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031731c2a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3305:x1874219323362432:12345-0@lo:400: Request processed in 4328us (5185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394903.640098:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787394903.640906:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394903.641545:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362560 00000100:00100000:3.0:1787394903.641553:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362560 00000100:00100000:3.0:1787394903.641585:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394903.641590:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a98ae2f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874219323362560:12345-0@lo:38: 00010000:00080000:3.0:1787394903.641618:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1787394903.641652:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xedbabbe2e89a7d35 00000004:00100000:3.0:1787394903.641726:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787394903.641888:0:5804:0:(import.c:65:import_set_state_nolock()) 0000000024c3497b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787394903.641966:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a98ae2f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874219323362560:12345-0@lo:38: Request processed in 375us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394903.641973:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787394903.644728:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e14d4cab x1874219323362560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787394913 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787394903.644750:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787394903.644760:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787394903.644772:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787394903.644775:0:3302:0:(import.c:65:import_set_state_nolock()) 000000006c8f300a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787394903.644782:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e14d4cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323362560:0@lo:38: 00010000:00010000:1.0:1787394904.532643:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394905.559683:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394906.579253:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787394907.223706:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787394907.223714:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b318a89000 from 3 10000000:01000000:0.0:1787394907.223719:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787394907.223760:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394907.223772:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394907.223781:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394907.223802:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007fd883b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323362688:0@lo:101: 00000100:00100000:0.0:1787394907.223864:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394907.223909:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 0000000088f703f9 going to sleep for 11 seconds 00000100:00100000:2.0:1787394907.223970:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362688 00000100:00100000:2.0:1787394907.223978:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362688 00000100:00100000:2.0:1787394907.224030:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787394907.224039:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fc209f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:5799:x1874219323362688:12345-0@lo:101: 00010000:00010000:2.0:1787394907.224051:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394907.224106:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009b7dea14/0xedbabbe2e89a7d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d3c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394907.224126:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009b7dea14/0xedbabbe2e89a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394907.224136:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009b7dea14/0xedbabbe2e89a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394907.224144:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009b7dea14, rc 0) 00000100:00100000:2.0:1787394907.224196:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fc209f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323362688:12345-0@lo:101: Request processed in 148us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394907.224203:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787394907.224247:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007fd883b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323362688:0@lo:101: 00010000:00010000:2.0:1787394907.224260:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394907.224267:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394907.224346:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7cdc14c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323362816:0@lo:256: 00000100:00100000:2.0:1787394907.224378:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394907.224398:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012837272 going to sleep for 11 seconds 00000100:00100000:0.0:1787394907.224446:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362816 00000100:00100000:0.0:1787394907.224450:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362816 00000100:00100000:0.0:1787394907.224480:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787394907.224486:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb35213a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323362816:12345-0@lo:256: 20000000:01000000:0.0:1787394907.224499:0:5796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787394907.224513:0:5796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787394907.224516:0:5796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787394907.224587:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb35213a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323362816:12345-0@lo:256: Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394907.224594:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787394907.224661:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7cdc14c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323362816:0@lo:256: 10000000:01000000:2.0:1787394907.224695:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787394907.224701:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394907.224709:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: 00000000240c0fe1/0xedbabbe2e89a7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394907.618519:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787394908.121560:0:6282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fff98950ad0 00000020:00000080:1.0:1787394908.121576:0:6282:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787394908.121581:0:6282:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787394908.121589:0:6282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff98952d60 20000000:00000080:1.0:1787394908.121595:0:6282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b305c78400 uarg=0000000000000000 20000000:01000000:1.0:1787394908.121628:0:6282:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787394908.121634:0:6282:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787394908.121639:0:6282:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787394908.121823:0:6282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787394908.121835:0:6282:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787394908.126687:0:6282:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787394908.126950:0:6282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787394908.127011:0:6282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787394908.127651:0:6282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787394908.127674:0:6282:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787394908.127690:0:6282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.127709:0:6282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.127717:0:6282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.127754:0:6282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.127767:0:6282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 11 pid: 5796 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394908.127781:0:6282:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000377fc6a9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6282:1874219323362944:0@lo:104: 00000100:00100000:0.0:1787394908.127844:0:6282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394908.127905:0:6282:0:(client.c:2702:ptlrpc_set_wait()) set 0000000093b1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787394908.128153:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323362944 00000100:00100000:2.0:1787394908.128162:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323362944 00000100:00100000:2.0:1787394908.128220:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787394908.128229:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc195c86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:6282:x1874219323362944:12345-0@lo:104: 00010000:00010000:2.0:1787394908.128240:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394908.128300:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787394908.128325:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc195c86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:6282:x1874219323362944:12345-0@lo:104: Request processed in 79us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394908.128332:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787394908.128511:0:6282:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000377fc6a9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6282:1874219323362944:0@lo:104: 00010000:00010000:0.0:1787394908.128529:0:6282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129378:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787394908.129393:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129402:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfd7bb7d already unused, calling callback (00000000ea2b7585) 10000000:00010000:0.0:1787394908.129405:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129414:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787394908.129420:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394908.129425:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787394908.129466:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129475:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787394908.129493:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129498:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: 00000000dfd7bb7d/0xedbabbe2e89a7d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d0b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129513:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394908.129514:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394908.129516:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394908.129528:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000377fc6a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323363072:0@lo:103: 00000100:00100000:0.0:1787394908.129565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394908.129619:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363072 00000100:00100000:0.0:1787394908.129624:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363072 00010000:00010000:0.0:1787394908.129649:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 12 pid: 5796 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394908.129674:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787394908.129681:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009c6ad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3306:x1874219323363072:12345-0@lo:103: 00010000:00010000:0.0:1787394908.129692:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787394908.129696:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 12 pid: 5796 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129705:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 12 pid: 5796 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129718:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5290dca/0xedbabbe2e89a7d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7d04 expref: 12 pid: 5796 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129728:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129735:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129748:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129754:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129760:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129766:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129781:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061ced1f5 already unused, calling callback (00000000ab881f7e) 00010000:00010000:0.0:1787394908.129785:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129791:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129804:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129813:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787394908.129842:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009c6ad16 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3306:x1874219323363072:12345-0@lo:103: Request processed in 162us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394908.129849:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787394908.129879:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000377fc6a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323363072:0@lo:103: 00010000:00010000:0.0:1787394908.129902:0:6282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129909:0:6282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394908.129914:0:6282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061ced1f5/0xedbabbe2e89a7d4a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394908.629800:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394908.754655:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787394908.754679:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036056ad0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323363200:0@lo:400: 00000100:00100000:0.0:1787394908.754760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394908.754961:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363200 00000100:00100000:2.0:1787394908.754969:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363200 00000100:00100000:2.0:1787394908.755024:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787394908.755032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000377fc6a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323363200:12345-0@lo:400: 00000100:00100000:2.0:1787394908.755103:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000377fc6a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323363200:12345-0@lo:400: Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394908.755112:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787394908.755634:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000036056ad0 x1874219323363200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394908.755648:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036056ad0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323363200:0@lo:400: 00010000:00010000:0.0:1787394909.650496:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394910.674476:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394911.698901:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394912.724663:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787394913.556404:0:6597:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787394913.556408:0:6597:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787394913.556515:0:6597:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000008281c384 00000020:01000004:1.0:1787394913.556766:0:6597:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787394913.556779:0:6597:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787394913.556795:0:6597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000090cbfd63) 00000020:00000080:1.0:1787394913.556813:0:6597:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787394913.573771:0:6597:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787394913.574110:0:6597:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787394913.610273:0:6597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787394913.628791:0:6597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787394913.628832:0:6597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787394913.628898:0:6597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787394913.628929:0:6597:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787394913.629341:0:6597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787394913.629352:0:6597:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787394913.629367:0:6597:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedbabbe2e89a7d58 00000020:01000004:3.0:1787394913.629374:0:6597:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787394913.629395:0:6597:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787394913.629398:0:6597:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787394913.629404:0:6597:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787394913.629408:0:6597:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787394913.629417:0:6597:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000aa81da12) 00000020:00000080:3.0:1787394913.629428:0:6597:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787394913.635191:0:6597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787394913.635396:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787394913.635403:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787394913.647459:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787394913.647475:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787394913.649438:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787394913.649452:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787394913.653431:0:6597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787394913.654409:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787394913.654417:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787394913.658925:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787394913.658941:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787394913.702422:0:6597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787394913.702852:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787394913.702859:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787394913.705121:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787394913.705137:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787394913.713152:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787394913.713177:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787394913.723430:0:6597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787394913.724069:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787394913.724077:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787394913.725215:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787394913.725224:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1787394913.746458:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394913.829617:0:6597:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787394913.829794:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787394913.829799:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787394913.835994:0:6597:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787394913.836007:0:6597:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787394913.836586:0:6597:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787394913.836611:0:6597:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787394913.836616:0:6597:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 10000000:01000000:3.0:1787394913.874418:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787394913.874426:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b318a89000 from 1 10000000:01000000:3.0:1787394913.874431:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787394913.874475:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: 00000000da24f7b9/0xedbabbe2e89a7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394913.874487:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: 00000000da24f7b9/0xedbabbe2e89a7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394913.874496:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: 00000000da24f7b9/0xedbabbe2e89a7d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394913.874521:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004b19960e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363328:0@lo:101: 00000100:00100000:3.0:1787394913.874614:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394913.875069:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e3327b90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323363584:0@lo:400: 00000100:00100000:0.0:1787394913.875103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394913.875237:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9096bc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323363456:0@lo:400: 00000100:00100000:1.0:1787394913.875270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394913.875334:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 00000000384db242 going to sleep for 11 seconds 00000100:00100000:3.0:1787394913.875355:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363584 00000100:00100000:3.0:1787394913.875362:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363584 00000100:00100000:3.0:1787394913.875409:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394913.875417:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010b5a633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323363584:12345-0@lo:400: 00000100:00100000:3.0:1787394913.875471:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010b5a633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323363584:12345-0@lo:400: Request processed in 55us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394913.875478:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787394913.875512:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e3327b90 x1874219323363584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394913.875525:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e3327b90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323363584:0@lo:400: 00000100:00100000:2.0:1787394913.886668:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363328 00000100:00100000:2.0:1787394913.886684:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363328 00000100:00100000:2.0:1787394913.886747:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363456 00000100:00100000:2.0:1787394913.886751:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363456 00000100:00100000:2.0:1787394913.886768:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787394913.886775:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000870e12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323363328:12345-0@lo:101: 00010000:00010000:2.0:1787394913.886791:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394913.886809:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa40625d/0xedbabbe2e89a7d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d66 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.886834:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa40625d/0xedbabbe2e89a7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.886844:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa40625d/0xedbabbe2e89a7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.886854:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa40625d, rc 0) 00000100:00100000:2.0:1787394913.886944:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000870e12cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323363328:12345-0@lo:101: Request processed in 169us (12331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.886952:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787394913.886981:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787394913.886987:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006855781c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3304:x1874219323363456:12345-0@lo:400: 00000100:00100000:2.0:1787394913.887021:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006855781c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3304:x1874219323363456:12345-0@lo:400: Request processed in 34us (11751us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.887027:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787394913.887075:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9096bc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323363456:0@lo:400: 00000100:00100000:2.0:1787394913.887110:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004b19960e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363328:0@lo:101: 00010000:00010000:2.0:1787394913.887123:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: 00000000da24f7b9/0xedbabbe2e89a7d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.887132:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: 00000000da24f7b9/0xedbabbe2e89a7d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394913.887212:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e7cdc14c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363712:0@lo:501: 00000100:00100000:2.0:1787394913.887243:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394913.887272:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 00000000474ab140 going to sleep for 11 seconds 00000100:00100000:2.0:1787394913.887283:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363712 00000100:00100000:2.0:1787394913.887286:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363712 00000100:00100000:2.0:1787394913.887303:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787394913.887337:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be792061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323363712:12345-0@lo:501: 00000100:00100000:2.0:1787394913.888387:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be792061 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323363712:12345-0@lo:501: Request processed in 1047us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.888398:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787394913.888535:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e7cdc14c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363712:0@lo:501: 00000100:00100000:3.0:1787394913.888595:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001554e03b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363840:0@lo:503: 00000100:00100000:3.0:1787394913.888637:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394913.888670:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ebe2aae going to sleep for 11 seconds 00000100:00100000:2.0:1787394913.888779:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363840 00000100:00100000:2.0:1787394913.888785:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363840 00000100:00100000:2.0:1787394913.888821:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787394913.888826:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b65221d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323363840:12345-0@lo:503: 00000100:00100000:2.0:1787394913.889059:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b65221d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323363840:12345-0@lo:503: Request processed in 232us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.889066:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787394913.889106:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001554e03b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323363840:0@lo:503: 00000100:00100000:2.0:1787394913.897034:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006314559e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6612:1874219323363968:0@lo:502: 00000100:00100000:2.0:1787394913.897128:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394913.897180:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dfe49141 going to sleep for 11 seconds 00000100:00100000:3.0:1787394913.897369:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323363968 00000100:00100000:3.0:1787394913.897378:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323363968 00000100:00100000:3.0:1787394913.897416:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787394913.897425:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d409569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6612:x1874219323363968:12345-0@lo:502: 00000100:00100000:3.0:1787394913.897666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d409569 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6612:x1874219323363968:12345-0@lo:502: Request processed in 242us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394913.897674:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000040:01000000:2.0:1787394913.906152:0:6597:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787394913.907062:0:6597:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787394913.907068:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787394913.907070:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787394913.907071:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787394913.907072:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787394913.907073:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787394913.907075:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787394913.907076:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787394913.907078:0:6597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787394913.907079:0:6597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787394913.907080:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787394913.907081:0:6597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787394913.907085:0:6597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787394913.907087:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787394913.907088:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787394913.907089:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787394913.907090:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787394913.907091:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787394913.907092:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787394913.907093:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787394913.907094:0:6597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787394913.907104:0:6597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787394913.907105:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787394913.907105:0:6597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1787394913.907170:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006314559e pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6612:1874219323363968:0@lo:502: 10000000:01000000:3.0:1787394913.907771:0:6597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787394913.907790:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000519ab892 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323364096:0@lo:253: 00000100:00100000:3.0:1787394913.907853:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394913.907920:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ebe2aae going to sleep for 11 seconds 00000100:00100000:0.0:1787394913.907995:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364096 00000100:00100000:0.0:1787394913.908003:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364096 00000100:00100000:0.0:1787394913.908054:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787394913.908062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc5cd48c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323364096:12345-0@lo:253: 20000000:01000000:0.0:1787394913.908103:0:5796:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787394913.908108:0:5796:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787394913.908112:0:5796:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787394913.908115:0:5796:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000020:01000000:2.0:1787394913.909073:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787394913.909083:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394913.909086:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787394913.909093:0:6612:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b318a89000 00000020:00000080:2.0:1787394913.909095:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787394913.909151:0:6612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6612:1874219323364224:0@lo:502: 00000100:00100000:2.0:1787394913.909276:0:6612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787394913.909719:0:5796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787394913.909931:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787394913.909945:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787394913.909998:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787394913.910007:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787394913.910039:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787394913.910104:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787394913.910543:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787394913.910564:0:5796:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.116@tcp 20000000:01000000:0.0:1787394913.910566:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.116@tcp (null) (null) (null) 00000040:00080000:0.0:1787394913.910603:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787394913.910619:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787394913.910672:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787394913.910682:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.116@tcp (null) (null) 00000040:00080000:0.0:1787394913.910713:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787394913.910722:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787394913.910751:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787394913.910815:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000100:00100000:2.0:1787394913.913419:0:6612:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000040:00080000:0.0:1787394913.914394:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787394913.914432:0:5796:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.116@tcp 20000000:01000000:0.0:1787394913.914436:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.116@tcp (null) (null) (null) 00000040:00080000:0.0:1787394913.914513:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787394913.914521:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787394913.914556:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787394913.914566:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.116@tcp (null) (null) 00000100:00100000:3.0:1787394913.914671:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364224 00000100:00100000:3.0:1787394913.914680:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364224 00000100:00100000:3.0:1787394913.914784:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787394913.914795:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6612:x1874219323364224:12345-0@lo:502: 00000100:00100000:3.0:1787394913.915085:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6612:x1874219323364224:12345-0@lo:502: Request processed in 292us (5808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394913.915094:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000040:00080000:0.0:1787394913.915231:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787394913.915245:0:5796:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787394913.915281:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787394913.915343:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787394913.915363:0:5796:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787394913.915366:0:5796:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787394913.915369:0:5796:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787394913.915382:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787394913.915384:0:5796:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787394913.915423:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787394913.915425:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787394913.915864:0:6613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787394913.915910:0:6613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787394913.915959:0:6613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787394913.916108:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787394913.916158:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787394913.916300:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787394913.916336:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787394913.916344:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787394913.917779:0:6614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1787394913.918118:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1787394913.918176:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1787394913.918362:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1787394913.918377:0:5796:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787394913.918380:0:5796:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000100:00100000:1.0:1787394913.918542:0:6612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6612:1874219323364224:0@lo:502: 00000020:01000000:1.0:1787394913.918653:0:6612:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394913.918662:0:6612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394913.918664:0:6612:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787394913.918677:0:6612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787394913.918797:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787394913.918815:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787394913.918825:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.918836:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787394913.919563:0:6615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787394913.919707:0:6615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787394913.919759:0:6615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787394913.920149:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787394913.920274:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787394913.920476:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787394913.920499:0:5796:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787394913.920502:0:5796:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787394913.920511:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787394913.920532:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920551:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920559:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920567:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920637:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920673:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920687:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.920700:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364352:0@lo:104: 00000100:00100000:1.0:1787394913.920760:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787394913.920844:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.920864:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 12 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.920872:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364480:0@lo:104: 00000100:00100000:1.0:1787394913.920895:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787394913.921014:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.921022:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 12 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.921030:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364608:0@lo:104: 00000100:00100000:1.0:1787394913.921051:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394913.921332:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364352 00000100:00100000:2.0:1787394913.921341:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364352 00000100:00100000:2.0:1787394913.921378:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364480 00000100:00100000:2.0:1787394913.921381:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364480 00000100:00100000:2.0:1787394913.921396:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787394913.921406:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:5796:x1874219323364352:12345-0@lo:104: 00010000:00010000:2.0:1787394913.921419:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921471:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787394913.921477:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:5796:x1874219323364352:12345-0@lo:104: Request processed in 73us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.921484:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787394913.921501:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787394913.921517:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5796:x1874219323364480:12345-0@lo:104: 00010000:00010000:2.0:1787394913.921524:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921555:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787394913.921559:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5796:x1874219323364480:12345-0@lo:104: Request processed in 45us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.921564:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787394913.921594:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787394913.921600:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921607:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1787394913.921611:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921619:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787394913.921626:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394913.921632:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787394913.921661:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921667:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787394913.921683:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921703:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d19 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921717:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787394913.921720:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921725:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1787394913.921728:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921735:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787394913.921741:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394913.921746:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787394913.921760:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921766:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787394913.921779:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921785:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ca9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.921796:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394913.921802:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394913.921804:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394913.921826:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323364736:0@lo:103: 00000100:00100000:2.0:1787394913.921855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394913.921890:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323364864:0@lo:103: 00000100:00100000:2.0:1787394913.921909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394913.921938:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364736 00000100:00100000:2.0:1787394913.921942:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364736 00010000:00010000:2.0:1787394913.921956:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394913.921973:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364864 00000100:00100000:2.0:1787394913.921976:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364864 00010000:00010000:2.0:1787394913.921994:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 14 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394913.922006:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787394913.922013:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3306:x1874219323364736:12345-0@lo:103: 00010000:00010000:2.0:1787394913.922022:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394913.922027:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 14 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.922036:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 14 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.922052:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787394913.922079:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3306:x1874219323364736:12345-0@lo:103: Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.922085:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787394913.922097:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787394913.922110:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3303:x1874219323364864:12345-0@lo:103: 00010000:00010000:2.0:1787394913.922117:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394913.922121:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.922129:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 13 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.922138:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787394913.922172:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3303:x1874219323364864:12345-0@lo:103: Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.922178:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787394913.922395:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323364864:0@lo:103: 00000100:00100000:2.0:1787394913.922419:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323364736:0@lo:103: 00010000:00010000:0.0:1787394913.922498:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394913.922660:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787394913.922674:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342044400/0xedbabbe2e89a7d19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7d12 expref: 12 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.922685:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364352:0@lo:104: 00010000:00010000:1.0:1787394913.922694:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342044200/0xedbabbe2e89a7ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7ca2 expref: 11 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.922702:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364480:0@lo:104: 00000100:00100000:2.0:1787394913.922746:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364608 00000100:00100000:2.0:1787394913.922751:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364608 00000100:00100000:2.0:1787394913.922772:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787394913.922778:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5796:x1874219323364608:12345-0@lo:104: 00010000:00010000:2.0:1787394913.922786:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394913.922841:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787394913.922846:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5796:x1874219323364608:12345-0@lo:104: Request processed in 69us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394913.922853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787394913.922894:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787394913.922900:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.922907:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787394913.922910:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.922918:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787394913.922925:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394913.922930:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787394913.922958:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.922971:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787394913.922991:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.922998:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7c8d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923014:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394913.923015:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394913.923017:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394913.923129:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323364992:0@lo:103: 00000100:00100000:2.0:1787394913.923165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394913.923333:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323364992 00000100:00100000:0.0:1787394913.923338:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323364992 00010000:00010000:0.0:1787394913.923356:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 11 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394913.923378:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787394913.923385:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3304:x1874219323364992:12345-0@lo:103: 00010000:00010000:0.0:1787394913.923392:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787394913.923396:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 11 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923405:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 11 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923418:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923425:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923448:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923455:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923461:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923467:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923473:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787394913.923477:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923483:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923491:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394913.923500:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787394913.923533:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3304:x1874219323364992:12345-0@lo:103: Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394913.923539:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787394913.923677:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7c86 expref: 10 pid: 5797 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394913.923689:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5796:1874219323364608:0@lo:104: 00010000:00010000:1.0:1787394913.923711:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.923728:0:5796:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.923735:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394913.923740:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7d74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787394913.923753:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787394913.923885:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323364992:0@lo:103: 00000100:00100000:3.0:1787394914.010450:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:6597:x1874219323364096:12345-0@lo:253: Request processed in 102379us (102587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.010465:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787394914.010708:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323364096:0@lo:253: 10000000:01000000:0.0:1787394914.010724:0:6597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787394914.010727:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787394914.010742:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787394914.010743:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787394914.010745:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787394914.010746:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787394914.010747:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787394914.010749:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787394914.010750:0:6597:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787394914.010752:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787394914.010754:0:6597:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787394914.010773:0:6597:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b305de9800 from lustre-OST0000 10000000:01000000:0.0:1787394914.010795:0:6597:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787394914.010798:0:6597:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787394914.010804:0:6597:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0b3181099c0 local copy 10000000:01000000:0.0:1787394914.010808:0:6597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787394914.010841:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.010852:0:6597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.010861:0:6597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.010878:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365120:0@lo:101: 00000100:00100000:0.0:1787394914.010911:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.010961:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.011120:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365120 00000100:00100000:3.0:1787394914.011127:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365120 00000100:00100000:3.0:1787394914.011188:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787394914.011389:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:6597:x1874219323365120:12345-0@lo:101: 00010000:00010000:3.0:1787394914.011401:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394914.011415:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342045000/0xedbabbe2e89a7d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d7b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.011440:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342045000/0xedbabbe2e89a7d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d7b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.011450:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342045000/0xedbabbe2e89a7d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d7b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.011459:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342045000, rc 0) 00000100:00100000:3.0:1787394914.011505:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:6597:x1874219323365120:12345-0@lo:101: Request processed in 121us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.011512:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787394914.011660:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365120:0@lo:101: 00010000:00010000:0.0:1787394914.011673:0:6597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.011682:0:6597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.011787:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365248:0@lo:501: 00000100:00100000:0.0:1787394914.011815:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.011845:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.011965:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365248 00000100:00100000:3.0:1787394914.011970:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365248 00000100:00100000:3.0:1787394914.012122:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787394914.012130:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:6597:x1874219323365248:12345-0@lo:501: 00000100:00100000:3.0:1787394914.012660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:6597:x1874219323365248:12345-0@lo:501: Request processed in 529us (842us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787394914.012668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787394914.013404:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365248:0@lo:501: 10000000:01000000:2.0:1787394914.013484:0:6597:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787394914.013600:0:6597:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787394914.013608:0:6597:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.013618:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.013624:0:6597:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.013648:0:6597:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787394914.013668:0:6597:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b305de9800 10000000:01000000:2.0:1787394914.013673:0:6597:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787394914.013677:0:6597:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0b3181099c0 10000000:01000000:2.0:1787394914.013680:0:6597:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787394914.013682:0:6597:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa0b3181099c0 from 1 10000000:01000000:2.0:1787394914.013685:0:6597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787394914.013709:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.013717:0:6597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.013726:0:6597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394914.013743:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365376:0@lo:101: 00000100:00100000:2.0:1787394914.013780:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787394914.013866:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787394914.013872:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.013880:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031c00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787394914.013884:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.013892:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787394914.013899:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394914.013905:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787394914.013924:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.013931:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787394914.013960:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.013967:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7d82 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.014010:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394914.014012:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394914.014014:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394914.014021:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787394914.014033:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323365504:0@lo:103: 00000100:00100000:0.0:1787394914.014060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.014106:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365504 00000100:00100000:0.0:1787394914.014111:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365504 00000100:00100000:0.0:1787394914.014181:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394914.014188:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:3306:x1874219323365504:12345-0@lo:103: 00000100:00100000:2.0:1787394914.014452:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00010000:00010000:0.0:1787394914.014649:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787394914.014664:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342045000/0xedbabbe2e89a7d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7d7b expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.014682:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787394914.014717:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:3306:x1874219323365504:12345-0@lo:103: Request processed in 529us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394914.014724:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394914.014760:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323365504:0@lo:103: 00000100:00100000:3.0:1787394914.015117:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365376 00000100:00100000:3.0:1787394914.015123:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365376 00000100:00100000:3.0:1787394914.015175:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787394914.015183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:6597:x1874219323365376:12345-0@lo:101: 00010000:00010000:3.0:1787394914.015384:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394914.015400:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342045600/0xedbabbe2e89a7d90 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d89 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.015418:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342045600/0xedbabbe2e89a7d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d89 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.015428:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342045600/0xedbabbe2e89a7d90 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d89 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.015435:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342045600, rc 0) 00000100:00100000:3.0:1787394914.015519:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:6597:x1874219323365376:12345-0@lo:101: Request processed in 336us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.015525:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787394914.015644:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365376:0@lo:101: 00010000:00010000:2.0:1787394914.015658:0:6597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.015667:0:6597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394914.015683:0:6597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787394914.015698:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.015704:0:6597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394914.015713:0:6597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787394914.015717:0:6597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787394914.015722:0:6597:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787394914.015724:0:6597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787394914.015740:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.015747:0:6597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.015755:0:6597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394914.015771:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365632:0@lo:101: 00000100:00100000:2.0:1787394914.015798:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.015837:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.015911:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365632 00000100:00100000:3.0:1787394914.015915:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365632 00000100:00100000:3.0:1787394914.015941:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787394914.015947:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+10:6597:x1874219323365632:12345-0@lo:101: 00010000:00010000:3.0:1787394914.015960:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394914.015968:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7d97 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.016107:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.016117:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394914.016124:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342045e00, rc 0) 00000100:00100000:3.0:1787394914.016327:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323365632:12345-0@lo:101: Request processed in 355us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.016334:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787394914.016468:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365632:0@lo:101: 00010000:00010000:2.0:1787394914.016479:0:6597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.016610:0:6597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394914.016704:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365760:0@lo:501: 00000100:00100000:2.0:1787394914.016729:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.016757:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.016808:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365760 00000100:00100000:3.0:1787394914.016813:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365760 00000100:00100000:3.0:1787394914.016847:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787394914.016854:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323365760:12345-0@lo:501: 00000100:00100000:3.0:1787394914.017393:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323365760:12345-0@lo:501: Request processed in 539us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.017400:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787394914.017664:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365760:0@lo:501: 00000100:00100000:2.0:1787394914.017698:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365888:0@lo:503: 00000100:00100000:2.0:1787394914.017738:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.017766:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.017814:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323365888 00000100:00100000:3.0:1787394914.017819:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323365888 00000100:00100000:3.0:1787394914.017850:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787394914.017856:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323365888:12345-0@lo:503: 00000100:00100000:3.0:1787394914.018328:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323365888:12345-0@lo:503: Request processed in 446us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.018336:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787394914.018616:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323365888:0@lo:503: 00000040:00080000:2.0:1787394914.018892:0:6597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787394914.018953:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366016:0@lo:502: 00000100:00100000:2.0:1787394914.019120:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.019167:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.019392:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366016 00000100:00100000:3.0:1787394914.019399:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366016 00000100:00100000:3.0:1787394914.019481:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787394914.019503:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323366016:12345-0@lo:502: 00000100:00100000:3.0:1787394914.019686:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323366016:12345-0@lo:502: Request processed in 197us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.019694:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787394914.019775:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366016:0@lo:502: 00000040:00080000:2.0:1787394914.020069:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787394914.020124:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787394914.020181:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787394914.020653:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787394914.020694:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787394914.020727:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787394914.020764:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366144:0@lo:502: 00000100:00100000:2.0:1787394914.020815:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.027861:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127240 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.027953:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366144 00000100:00100000:1.0:1787394914.027962:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366144 00000100:00100000:1.0:1787394914.028686:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787394914.028697:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323366144:12345-0@lo:502: 00000100:00100000:1.0:1787394914.029088:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323366144:12345-0@lo:502: Request processed in 394us (8272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.029096:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787394914.032274:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366144:0@lo:502: 00000040:00080000:2.0:1787394914.032478:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787394914.033804:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787394914.043884:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787394914.043897:0:6616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787394914.043904:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394914.043906:0:6616:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787394914.043913:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787394914.043928:0:6616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0b305ce8000) 00000020:00000080:1.0:1787394914.043949:0:6616:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787394914.043954:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787394914.044238:0:6616:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b305de9800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787394914.044246:0:6616:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787394914.044254:0:6616:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedbabbe2e89a7dac 00010000:00010000:3.0:1787394914.054809:0:6616:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787394914.055423:0:6616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787394914.059795:0:6616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787394914.060298:0:6616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787394914.074832:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787394914.076747:0:6616:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787394914.085719:0:6616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787394914.085733:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787394914.085739:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394914.085741:0:6616:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787394914.085744:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787394914.085748:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394914.085749:0:6616:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787394914.085752:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787394914.085754:0:6616:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787394914.085820:0:6616:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787394914.085824:0:6616:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394914.085825:0:6616:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787394914.085828:0:6616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787394914.093507:0:6597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787394914.093553:0:6597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787394914.093575:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.093589:0:6597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394914.093598:0:6597:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b305de9800 from 1 10000000:01000000:2.0:1787394914.093601:0:6597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787394914.093639:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.093648:0:6597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.093659:0:6597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394914.093681:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366272:0@lo:101: 00000100:00100000:2.0:1787394914.093743:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.093787:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308127840 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.098116:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366272 00000100:00100000:1.0:1787394914.098155:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366272 00000100:00100000:1.0:1787394914.098215:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787394914.098225:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:6597:x1874219323366272:12345-0@lo:101: 00010000:00010000:1.0:1787394914.098242:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394914.098260:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7db3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.098290:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.098301:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.098337:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167400, rc 0) 00000100:00100000:1.0:1787394914.098413:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366272:12345-0@lo:101: Request processed in 190us (4669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.098421:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787394914.098728:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366272:0@lo:101: 00010000:00010000:0.0:1787394914.098746:0:6597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.098756:0:6597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.098885:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366400:0@lo:501: 00000100:00100000:0.0:1787394914.098921:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.098955:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787394914.099345:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366400 00000100:00100000:2.0:1787394914.099359:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366400 00000100:00100000:2.0:1787394914.099391:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787394914.099399:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366400:12345-0@lo:501: 00000100:00100000:2.0:1787394914.099635:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366400:12345-0@lo:501: Request processed in 236us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.099642:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787394914.100156:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366400:0@lo:501: 00000100:00100000:0.0:1787394914.100194:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366528:0@lo:503: 00000100:00100000:0.0:1787394914.100240:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.100265:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787394914.100388:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366528 00000100:00100000:2.0:1787394914.100393:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366528 00000100:00100000:2.0:1787394914.100424:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787394914.100430:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366528:12345-0@lo:503: 00000100:00100000:2.0:1787394914.100592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366528:12345-0@lo:503: Request processed in 161us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.100599:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787394914.102493:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366528:0@lo:503: 00000040:00080000:0.0:1787394914.102870:0:6597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787394914.102947:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366656:0@lo:502: 00000100:00100000:0.0:1787394914.103273:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.103338:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.103443:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366656 00000100:00100000:1.0:1787394914.103450:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366656 00000100:00100000:1.0:1787394914.103508:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787394914.103520:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366656:12345-0@lo:502: 00000100:00100000:1.0:1787394914.103733:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366656:12345-0@lo:502: Request processed in 214us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.103741:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787394914.104697:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366656:0@lo:502: 00000040:00080000:0.0:1787394914.105277:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787394914.105410:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787394914.105448:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366784:0@lo:502: 00000100:00100000:0.0:1787394914.106079:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.106113:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.106257:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366784 00000100:00100000:1.0:1787394914.106264:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366784 00000100:00100000:1.0:1787394914.106339:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787394914.106349:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366784:12345-0@lo:502: 00000100:00100000:1.0:1787394914.106558:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366784:12345-0@lo:502: Request processed in 210us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.106572:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787394914.106775:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366784:0@lo:502: 00000040:00080000:0.0:1787394914.106886:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787394914.106900:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787394914.108291:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787394914.108303:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394914.108678:0:6620:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787394914.108698:0:6620:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b305de9800 00000020:00000080:1.0:1787394914.108702:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787394914.108731:0:6620:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394914.108734:0:6620:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394914.108736:0:6620:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787394914.108739:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787394914.109231:0:6597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787394914.109256:0:6597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787394914.109278:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.109299:0:6597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394914.109951:0:6597:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787394914.109954:0:6597:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b305de9800 10000000:01000000:0.0:1787394914.109957:0:6597:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b305de9800 10000000:01000000:0.0:1787394914.109961:0:6597:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787394914.109967:0:6597:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b305de9800 from 1 10000000:01000000:0.0:1787394914.109969:0:6597:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787394914.110077:0:6597:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.110087:0:6597:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.110097:0:6597:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.110117:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366912:0@lo:101: 00000100:00100000:0.0:1787394914.110385:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.110460:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787394914.112464:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323366912 00000100:00100000:2.0:1787394914.112478:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323366912 00000100:00100000:2.0:1787394914.112568:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787394914.112579:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323366912:12345-0@lo:101: 00010000:00010000:2.0:1787394914.112595:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394914.112612:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7dc1 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.112639:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.112651:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.112660:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b30148f000, rc 0) 00000100:00100000:2.0:1787394914.112727:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323366912:12345-0@lo:101: Request processed in 150us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.112748:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787394914.112835:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323366912:0@lo:101: 00010000:00010000:0.0:1787394914.112853:0:6597:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.112863:0:6597:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.112997:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367040:0@lo:501: 00000100:00100000:0.0:1787394914.113044:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.113529:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.113594:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367040 00000100:00100000:1.0:1787394914.113600:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367040 00000100:00100000:1.0:1787394914.113625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787394914.113632:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367040:12345-0@lo:501: 00000100:00100000:1.0:1787394914.113872:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367040:12345-0@lo:501: Request processed in 239us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.113879:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787394914.113998:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367040:0@lo:501: 00000100:00100000:0.0:1787394914.114029:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367168:0@lo:503: 00000100:00100000:0.0:1787394914.114068:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.114088:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.114342:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367168 00000100:00100000:1.0:1787394914.114347:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367168 00000100:00100000:1.0:1787394914.114366:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787394914.114372:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367168:12345-0@lo:503: 00000100:00100000:1.0:1787394914.117315:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367168:12345-0@lo:503: Request processed in 2922us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.117330:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787394914.119538:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367168:0@lo:503: 00000040:00080000:0.0:1787394914.120269:0:6597:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787394914.121282:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367296:0@lo:502: 00000100:00100000:0.0:1787394914.121468:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.121587:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3083466c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.127413:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367296 00000100:00100000:3.0:1787394914.127427:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367296 00000100:00100000:2.0:1787394914.127703:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787394914.127715:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367296:12345-0@lo:502: 00000100:00100000:2.0:1787394914.128163:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367296:12345-0@lo:502: Request processed in 448us (6694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.128171:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787394914.128899:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367296:0@lo:502: 00000040:00080000:0.0:1787394914.129466:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787394914.129524:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787394914.129551:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787394914.129591:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787394914.129629:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787394914.129677:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787394914.129713:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787394914.129747:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787394914.129864:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787394914.129904:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787394914.129937:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787394914.130055:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787394914.130099:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787394914.130231:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787394914.130286:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787394914.130640:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787394914.130679:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787394914.130734:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787394914.131062:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787394914.131103:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787394914.131595:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787394914.131644:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787394914.131683:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787394914.131747:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787394914.132513:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787394914.132550:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787394914.132681:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787394914.132723:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787394914.132827:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367424:0@lo:502: 00000100:00100000:0.0:1787394914.132904:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.133076:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3083466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394914.133280:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367424 00000100:00100000:2.0:1787394914.133289:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367424 00000100:00100000:2.0:1787394914.133446:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787394914.133456:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367424:12345-0@lo:502: 00000100:00100000:2.0:1787394914.133687:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367424:12345-0@lo:502: Request processed in 232us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.133695:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787394914.133786:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367424:0@lo:502: 00000040:00080000:0.0:1787394914.133871:0:6597:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787394914.133880:0:6597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787394914.134680:0:6621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787394914.134703:0:6621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0b33f938000) 00000020:00000080:0.0:1787394914.134723:0:6621:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787394914.135192:0:6621:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b305de9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787394914.135197:0:6621:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b305de9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787394914.135200:0:6621:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b305de9800 3 00010000:00080000:0.0:1787394914.135227:0:6621:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b3393fa000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787394914.137511:0:6621:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787394914.137627:0:6621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787394914.137675:0:6621:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787394914.137692:0:6621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xedbabbe2e89a7dd6 00000100:00080000:0.0:1787394914.137702:0:6621:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787394914.137708:0:6621:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0b3393fa000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787394914.137740:0:6621:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b3367bea00 x1874219323367552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787394914.137781:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323367552:0@lo:38: 00000100:00100000:0.0:1787394914.137841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.137900:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367552 00000100:00100000:0.0:1787394914.137906:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367552 00000100:00100000:0.0:1787394914.137934:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787394914.137942:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323367552:12345-0@lo:38: 00010000:00080000:0.0:1787394914.137963:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000100:00080000:2.0:1787394914.141088:0:6621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787394914.141293:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394914.141347:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323367680:0@lo:400: 00000100:00100000:3.0:1787394914.141410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.141824:0:5803:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787394914.141834:0:5803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000080:0.0:1787394914.141860:0:5802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xedbabbe2e89a7ddd 00000004:00100000:0.0:1787394914.141875:0:5802:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787394914.141923:0:5802:0:(import.c:65:import_set_state_nolock()) ffffa0b318c23000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787394914.146177:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874219323367552:12345-0@lo:38: Request processed in 8226us (8327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394914.146191:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787394914.146221:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367680 00000100:00100000:0.0:1787394914.146228:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367680 00000100:00100000:0.0:1787394914.146276:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787394914.146284:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323367680:12345-0@lo:400: 00000100:00100000:0.0:1787394914.146376:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323367680:12345-0@lo:400: Request processed in 92us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394914.146392:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787394914.146434:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0b3291a1f80 x1874219323367680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394914.146448:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323367680:0@lo:400: 00000040:00080000:1.0:1787394914.153534:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787394914.153587:0:6597:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787394914.153611:0:6597:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787394914.153628:0:6597:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.153649:0:6597:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787394914.153698:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787394914.153700:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787394914.153702:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394914.153703:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394914.153704:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394914.153705:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394914.153707:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394914.153708:0:6597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394914.153709:0:6597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394914.153711:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394914.153712:0:6597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394914.153716:0:6597:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787394914.153718:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787394914.153719:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787394914.153720:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394914.153721:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394914.153722:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394914.153723:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394914.153724:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394914.153725:0:6597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394914.153726:0:6597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394914.153727:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394914.153728:0:6597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394914.153752:0:6597:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787394914.153770:0:6597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367808:0@lo:253: 00000100:00100000:1.0:1787394914.153838:0:6597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394914.153890:0:6597:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f9146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394914.157404:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367808 00000100:00100000:3.0:1787394914.157428:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367808 00000100:00100000:3.0:1787394914.157475:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787394914.157484:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6597:x1874219323367808:12345-0@lo:253: 20000000:01000000:3.0:1787394914.157528:0:5795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787394914.157541:0:5795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1787394914.158287:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0b3367bea00 x1874219323367552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787394924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394914.158301:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787394914.158332:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787394914.158341:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787394914.158347:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787394914.158351:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b3393fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787394914.158358:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323367552:0@lo:38: 20000000:01000000:1.0:1787394914.196875:0:5795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787394914.196894:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787394914.197004:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787394914.197009:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787394914.197031:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.197050:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.197058:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.197096:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.197110:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 13 pid: 5797 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.197124:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323367936:0@lo:104: 00000100:00100000:0.0:1787394914.197192:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394914.197251:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787394914.197478:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323367936 00000100:00100000:1.0:1787394914.197487:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323367936 00000100:00100000:1.0:1787394914.197527:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787394914.197549:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323367936:12345-0@lo:104: 00010000:00010000:1.0:1787394914.197561:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.197617:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787394914.197623:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323367936:12345-0@lo:104: Request processed in 76us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394914.197630:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787394914.198082:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323367936:0@lo:104: 00010000:00010000:0.0:1787394914.198100:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198118:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787394914.198130:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198145:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787394914.198150:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198159:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787394914.198165:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394914.198171:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787394914.198206:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198212:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787394914.198232:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198239:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d43 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394914.198255:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394914.198257:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394914.198259:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394914.198274:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323368064:0@lo:103: 00000100:00100000:0.0:1787394914.200086:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394914.200255:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368064 00000100:00100000:2.0:1787394914.200263:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368064 00010000:00010000:2.0:1787394914.200295:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 14 pid: 5797 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394914.200371:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787394914.200380:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3303:x1874219323368064:12345-0@lo:103: 00010000:00010000:2.0:1787394914.200394:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394914.200399:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 14 pid: 5797 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200410:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 14 pid: 5797 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200428:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b30148f400/0xedbabbe2e89a7d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7d3c expref: 14 pid: 5797 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200445:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200453:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787394914.200470:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003460189s 00010000:00010000:2.0:1787394914.200474:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200481:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200488:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200495:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200507:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787394914.200511:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200518:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200537:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394914.200549:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787394914.200597:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3303:x1874219323368064:12345-0@lo:103: Request processed in 218us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394914.200604:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787394914.200696:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.200705:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394914.200711:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7de4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394914.200794:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323368064:0@lo:103: 00000100:00100000:3.0:1787394914.226227:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:6597:x1874219323367808:12345-0@lo:253: Request processed in 68734us (72379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394914.226241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787394914.229160:0:6597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6597:1874219323367808:0@lo:253: 10000000:01000000:1.0:1787394914.229180:0:6597:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787394914.229184:0:6597:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787394914.229186:0:6597:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787394914.229187:0:6597:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394914.229188:0:6597:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394914.229189:0:6597:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394914.229191:0:6597:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394914.229192:0:6597:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394914.229194:0:6597:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394914.229195:0:6597:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394914.229197:0:6597:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394914.229198:0:6597:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787394914.229216:0:6597:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787394914.235993:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394914.236209:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787394914.240574:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394914.240787:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787394914.241025:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394914.241256:0:6597:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787394914.243874:0:6597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787394914.548007:0:6597:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787394914.548014:0:6597:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787394914.548045:0:6597:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787394914.548102:0:6597:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787394914.548121:0:6597:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787394914.548158:0:6597:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787394914.772145:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394915.800051:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394916.820147:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394917.848072:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394918.874484:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394919.506447:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323368192:0@lo:400: 00000100:00100000:3.0:1787394919.506466:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323368320:0@lo:400: 00000100:00100000:3.0:1787394919.508254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394919.508335:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787394919.508335:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368320 00000100:00100000:3.0:1787394919.508346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323368448:0@lo:400: 00000100:00100000:3.0:1787394919.508377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394919.508628:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368320 00000100:00100000:1.0:1787394919.508675:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368448 00000100:00100000:1.0:1787394919.508678:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368448 00000100:00100000:1.0:1787394919.508705:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787394919.508713:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323368320:12345-0@lo:400: 00000100:00100000:1.0:1787394919.508763:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323368320:12345-0@lo:400: Request processed in 51us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394919.508770:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787394919.508784:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787394919.508790:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323368448:12345-0@lo:400: 00000100:00100000:1.0:1787394919.508813:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323368448:12345-0@lo:400: Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394919.508818:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787394919.508832:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787394919.509002:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a3b80 x1874219323368448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394919.509016:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323368448:0@lo:400: 00010000:00080000:3.0:1787394919.509026:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a0700 x1874219323368320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394919.509034:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323368320:0@lo:400: 00000100:00100000:0.0:1787394919.510027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394919.510404:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368192 00000100:00100000:1.0:1787394919.510410:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368192 00000100:00100000:1.0:1787394919.510536:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787394919.510545:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3304:x1874219323368192:12345-0@lo:400: 00000100:00100000:1.0:1787394919.510594:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3304:x1874219323368192:12345-0@lo:400: Request processed in 50us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394919.510600:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787394919.510707:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323368192:0@lo:400: 00010000:00010000:0.0:1787394919.890704:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787394920.539550:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787394920.539557:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b318a89000 from 21 10000000:01000000:3.0:1787394920.539569:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787394920.539606:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.539618:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.539628:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.539650:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368576:0@lo:101: 00000100:00100000:3.0:1787394920.539711:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.539751:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.539807:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368576 00000100:00100000:0.0:1787394920.539815:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368576 00000100:00100000:0.0:1787394920.539869:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787394920.539879:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323368576:12345-0@lo:101: 00010000:00010000:0.0:1787394920.539891:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394920.539903:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7deb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.539924:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.540054:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.540064:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030a00, rc 0) 00000100:00100000:0.0:1787394920.540112:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323368576:12345-0@lo:101: Request processed in 235us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.540119:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787394920.540569:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368576:0@lo:101: 00010000:00010000:3.0:1787394920.540584:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.540593:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.540646:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368704:0@lo:501: 00000100:00100000:3.0:1787394920.540673:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.540693:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.540742:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368704 00000100:00100000:0.0:1787394920.540746:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368704 00000100:00100000:0.0:1787394920.540782:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787394920.540790:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323368704:12345-0@lo:501: 00000100:00100000:0.0:1787394920.541248:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323368704:12345-0@lo:501: Request processed in 458us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.541256:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787394920.541352:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368704:0@lo:501: 00000100:00100000:3.0:1787394920.541378:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368832:0@lo:503: 00000100:00100000:3.0:1787394920.541413:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.541429:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.542552:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368832 00000100:00100000:0.0:1787394920.542562:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368832 00000100:00100000:0.0:1787394920.542600:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787394920.542609:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323368832:12345-0@lo:503: 00000100:00100000:0.0:1787394920.544194:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323368832:12345-0@lo:503: Request processed in 1578us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.544207:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787394920.544580:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323368832:0@lo:503: 00000100:00100000:3.0:1787394920.546571:0:6954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6954:1874219323368960:0@lo:502: 00000100:00100000:3.0:1787394920.546641:0:6954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.546685:0:6954:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.546999:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323368960 00000100:00100000:0.0:1787394920.547006:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323368960 00000100:00100000:0.0:1787394920.547049:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787394920.547058:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6954:x1874219323368960:12345-0@lo:502: 00000100:00100000:0.0:1787394920.547358:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6954:x1874219323368960:12345-0@lo:502: Request processed in 300us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.547367:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787394920.548611:0:6954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6954:1874219323368960:0@lo:502: 00000100:00100000:3.0:1787394920.548672:0:6954:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6954:1874219323369088:0@lo:502: 00000100:00100000:3.0:1787394920.548723:0:6954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.548753:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369088 00000100:00100000:3.0:1787394920.548758:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369088 00000100:00100000:3.0:1787394920.548789:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787394920.548797:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6954:x1874219323369088:12345-0@lo:502: 00000100:00100000:3.0:1787394920.549687:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:6954:x1874219323369088:12345-0@lo:502: Request processed in 886us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.549696:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787394920.549747:0:6954:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.549763:0:6954:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6954:1874219323369088:0@lo:502: 00000040:00080000:3.0:1787394920.549790:0:6954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787394920.549849:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787394920.550058:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787394920.550067:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.550078:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394920.550088:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787394920.550090:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b318a89000 from 4 10000000:01000000:3.0:1787394920.550108:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787394920.550134:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.550142:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.550151:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.550167:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369216:0@lo:101: 00000100:00100000:3.0:1787394920.550198:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.550225:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.551692:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369216 00000100:00100000:0.0:1787394920.551704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369216 00000100:00100000:0.0:1787394920.551756:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787394920.551766:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323369216:12345-0@lo:101: 00010000:00010000:0.0:1787394920.551779:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394920.551795:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7df9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.551819:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.551837:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.551846:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030800, rc 0) 00000100:00100000:0.0:1787394920.551914:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323369216:12345-0@lo:101: Request processed in 149us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.551921:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787394920.552085:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369216:0@lo:101: 00010000:00010000:3.0:1787394920.552207:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.552216:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.552268:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369344:0@lo:256: 00000100:00100000:3.0:1787394920.552326:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.552352:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.552365:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369344 00000100:00100000:3.0:1787394920.552368:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369344 00000100:00100000:3.0:1787394920.553585:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787394920.553596:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323369344:12345-0@lo:256: 20000000:01000000:3.0:1787394920.553615:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787394920.553631:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787394920.553638:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787394920.553724:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323369344:12345-0@lo:256: Request processed in 130us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.553731:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787394920.553770:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369344:0@lo:256: 10000000:01000000:3.0:1787394920.553810:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787394920.553819:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.553828:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394920.553836:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787394920.553839:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1787394920.553842:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787394920.554557:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.554569:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.554577:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.554593:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369472:0@lo:101: 00000100:00100000:3.0:1787394920.554629:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.554656:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.555030:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369472 00000100:00100000:0.0:1787394920.555037:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369472 00000100:00100000:0.0:1787394920.555079:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787394920.555087:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323369472:12345-0@lo:101: 00010000:00010000:0.0:1787394920.555106:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394920.555118:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e07 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.555140:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.555150:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394920.555158:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030600, rc 0) 00000100:00100000:0.0:1787394920.555194:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323369472:12345-0@lo:101: Request processed in 108us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.555201:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787394920.555606:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369472:0@lo:101: 00010000:00010000:3.0:1787394920.555622:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.555637:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.555686:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369600:0@lo:501: 00000100:00100000:3.0:1787394920.555717:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.555749:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787394920.561202:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369600 00000100:00100000:0.0:1787394920.561213:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369600 00000100:00100000:0.0:1787394920.561262:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787394920.561278:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323369600:12345-0@lo:501: 00000100:00100000:0.0:1787394920.561562:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323369600:12345-0@lo:501: Request processed in 284us (5843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.561570:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787394920.561882:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369600:0@lo:501: 00000100:00100000:3.0:1787394920.561937:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369728:0@lo:503: 00000100:00100000:3.0:1787394920.561979:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.562005:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.562020:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369728 00000100:00100000:3.0:1787394920.562023:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369728 00000100:00100000:3.0:1787394920.562050:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787394920.562057:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323369728:12345-0@lo:503: 00000100:00100000:3.0:1787394920.562362:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323369728:12345-0@lo:503: Request processed in 305us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.562370:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787394920.562404:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323369728:0@lo:503: 00000100:00100000:3.0:1787394920.562728:0:6955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6955:1874219323369856:0@lo:502: 00000100:00100000:3.0:1787394920.562762:0:6955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.562781:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369856 00000100:00100000:3.0:1787394920.562784:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369856 00000100:00100000:3.0:1787394920.562805:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787394920.562811:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:6955:x1874219323369856:12345-0@lo:502: 00000100:00100000:3.0:1787394920.563146:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:6955:x1874219323369856:12345-0@lo:502: Request processed in 335us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.563152:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787394920.563190:0:6955:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30b8f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.563202:0:6955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6955:1874219323369856:0@lo:502: 00000020:01000000:3.0:1787394920.563223:0:6955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787394920.563230:0:6955:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787394920.563237:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394920.563239:0:6955:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787394920.563243:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787394920.563247:0:6955:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:3.0:1787394920.563266:0:6955:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787394920.563268:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787394920.563282:0:6955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0b31810cd40) 00000020:00000080:3.0:1787394920.563301:0:6955:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1787394920.563330:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787394920.563392:0:6955:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787394920.563396:0:6955:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787394920.563403:0:6955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7e1c 00010000:00080000:3.0:1787394920.563437:0:6955:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b302d9f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1787394920.564121:0:6955:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787394920.634812:0:6955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787394920.634833:0:6955:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787394920.635416:0:6955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394920.635602:0:6955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394920.635658:0:6955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787394920.635717:0:6955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787394920.637695:0:6963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787394920.637701:0:6963:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787394920.641299:0:6955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787394920.641341:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787394920.641377:0:6955:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787394920.641398:0:6955:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a7e23 00000100:00080000:1.0:1787394920.641407:0:6955:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787394920.641413:0:6955:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0b302d9f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787394920.641550:0:6955:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa52a00 x1874219323369984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787394920.641608:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323369984:0@lo:8: 00000100:00100000:0.0:1787394920.641674:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787394920.641928:0:6955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787394920.642068:0:6955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394920.642073:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394920.642075:0:6955:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787394920.642078:0:6955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787394920.642082:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394920.642083:0:6955:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787394920.642086:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787394920.642088:0:6955:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787394920.642123:0:6955:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6955:1874219323370112:0@lo:502: 00000100:00100000:1.0:1787394920.642166:0:6955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394920.642184:0:6955:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318bb9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.642300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370112 00000100:00100000:3.0:1787394920.642329:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370112 00000100:00100000:3.0:1787394920.642368:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787394920.642378:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:6955:x1874219323370112:12345-0@lo:502: 00000100:00100000:0.0:1787394920.642560:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323369984 00000100:00100000:0.0:1787394920.642565:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323369984 00000100:00100000:0.0:1787394920.642584:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787394920.642590:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323369984:12345-0@lo:8: 00010000:00080000:0.0:1787394920.642612:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:0.0:1787394920.642639:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a7e2a 00002000:00100000:0.0:1787394920.642669:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0b33fa8c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787394920.642674:0:6599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787394920.642677:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787394920.642789:0:6599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787394920.643024:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323370368:0@lo:400: 00000100:00100000:1.0:1787394920.643062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394920.643091:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787394920.643106:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323370240:0@lo:400: 00000100:00100000:1.0:1787394920.643127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394920.643154:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370368 00000100:00100000:1.0:1787394920.643158:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370368 00000100:00100000:1.0:1787394920.643181:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370240 00000100:00100000:1.0:1787394920.643184:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370240 00000100:00100000:1.0:1787394920.643200:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787394920.643206:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323370368:12345-0@lo:400: 00000100:00100000:1.0:1787394920.643247:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323370368:12345-0@lo:400: Request processed in 41us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394920.643254:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787394920.643267:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787394920.643273:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323370240:12345-0@lo:400: 00000100:00100000:1.0:1787394920.643300:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323370240:12345-0@lo:400: Request processed in 28us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394920.643321:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787394920.643357:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a0700 x1874219323370240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394920.643369:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323370240:0@lo:400: 00010000:00080000:1.0:1787394920.643379:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a3b80 x1874219323370368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394920.643388:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323370368:0@lo:400: 00000100:00100000:3.0:1787394920.643667:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:6955:x1874219323370112:12345-0@lo:502: Request processed in 1290us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.643674:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00002000:00080000:0.0:1787394920.644073:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787394920.644105:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b33fa89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787394920.644150:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874219323369984:12345-0@lo:8: Request processed in 1559us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394920.644157:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787394920.644191:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa52a00 x1874219323369984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787394930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394920.644201:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787394920.644209:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787394920.644217:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787394920.644228:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787394920.644231:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787394920.644241:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787394920.644246:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323369984:0@lo:8: 00000004:00080000:0.0:1787394920.644269:0:6963:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787394920.644389:0:6963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 192593081919ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787394920.645562:0:6955:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:6955:1874219323370112:0@lo:502: 00000020:01000000:1.0:1787394920.645597:0:6955:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394920.645604:0:6955:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394920.645611:0:6955:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787394920.645616:0:6955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1787394920.647271:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787394920.647299:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787394920.647336:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.647349:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394920.647359:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787394920.647361:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0b3181099c0 from 1 10000000:01000000:3.0:1787394920.647364:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787394920.647396:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.647403:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.647412:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.647431:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323370496:0@lo:101: 00000100:00100000:3.0:1787394920.647500:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.647541:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30b8f6840 going to sleep for 11 seconds 00000100:00100000:1.0:1787394920.648354:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370496 00000100:00100000:1.0:1787394920.648361:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370496 00000100:00100000:1.0:1787394920.648399:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787394920.648408:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323370496:12345-0@lo:101: 00010000:00010000:1.0:1787394920.648420:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394920.648433:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e31 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394920.648521:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394920.648532:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394920.648541:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166c00, rc 0) 00000100:00100000:1.0:1787394920.648584:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323370496:12345-0@lo:101: Request processed in 177us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394920.648591:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787394920.655069:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323370496:0@lo:101: 00010000:00010000:3.0:1787394920.655108:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.655120:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394920.655204:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323370624:0@lo:501: 00000100:00100000:3.0:1787394920.655258:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.655290:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30b8f6840 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.655327:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370624 00000100:00100000:3.0:1787394920.655332:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370624 00000100:00100000:3.0:1787394920.655371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787394920.655380:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323370624:12345-0@lo:501: 00000100:00100000:3.0:1787394920.657728:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323370624:12345-0@lo:501: Request processed in 2339us (2460us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787394920.657740:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787394920.657804:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323370624:0@lo:501: 10000000:01000000:3.0:1787394920.657837:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787394920.657847:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394920.659554:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1787394920.721151:0:6972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:0.0:1787394920.773221:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787394920.896762:0:6965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787394920.896795:0:6965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323370880:0@lo:7: 00000100:00100000:3.0:1787394920.896864:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.896913:0:6965:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.896943:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323370752:0@lo:13: 00000100:00100000:3.0:1787394920.896967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.897010:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370752 00000100:00100000:3.0:1787394920.897031:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370752 00000100:00100000:3.0:1787394920.897081:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394920.897090:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323370752:12345-0@lo:13: 00002000:00000024:3.0:1787394920.897128:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787394920.897169:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323370752:12345-0@lo:13: Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.897176:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787394920.897196:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787394920.897223:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a2300 x1874219323370752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394920.897239:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323370752:0@lo:13: 00000100:00100000:3.0:1787394920.897479:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323370880 00000100:00100000:3.0:1787394920.897484:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323370880 00000100:00100000:3.0:1787394920.897603:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394920.897610:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1874219323370880:12345-0@lo:7: 00002000:00080000:2.0:1787394920.916265:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787394920.916274:0:6602:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00010000:00010000:3.0:1787394920.916452:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394920.916660:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1874219323370880:12345-0@lo:7: Request processed in 19045us (19791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394920.916672:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787394920.916765:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a1c00 x1874219323370880/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787394936 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394920.916778:0:6965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323370880:0@lo:7: 00000004:00080000:3.0:1787394920.916791:0:6965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787394920.916830:0:6965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371008:0@lo:5: 00000100:00100000:3.0:1787394920.916863:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.916901:0:6965:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.916919:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371008 00000100:00100000:3.0:1787394920.916924:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371008 00000100:00100000:3.0:1787394920.916964:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787394920.916972:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6965:x1874219323371008:12345-0@lo:5: 00002000:00080000:3.0:1787394920.917009:0:6601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787394920.917013:0:6601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787394920.917236:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6965:x1874219323371008:12345-0@lo:5: Request processed in 264us (371us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787394920.917243:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787394920.917465:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a1c00 x1874219323371008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787394936 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394920.917476:0:6965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371008:0@lo:5: 00000004:00080000:2.0:1787394920.917485:0:6965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787394920.917509:0:6965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371136:0@lo:700: 00000100:00100000:2.0:1787394920.917533:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394920.917566:0:6965:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.917612:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371136 00000100:00100000:3.0:1787394920.917616:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371136 00000100:00100000:3.0:1787394920.917641:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394920.917647:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6965:x1874219323371136:12345-0@lo:700: 00000100:00100000:3.0:1787394920.917677:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6608:1874219323371264:0@lo:700: 00000100:00100000:3.0:1787394920.917704:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394920.917727:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3037d0900 going to sleep for 11 seconds 00000100:00100000:3.0:1787394920.917770:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371264 00000100:00100000:3.0:1787394920.917775:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371264 00000100:00100000:3.0:1787394920.917799:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394920.917805:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6608:x1874219323371264:12345-0@lo:700: 40000000:02000000:2.0:1787394920.949768:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1787394920.961175:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6608:x1874219323371264:12345-0@lo:700: Request processed in 43362us (43462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394920.961190:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787394920.961298:0:6608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a1180 x1874219323371264/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787394936 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394920.961337:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6608:1874219323371264:0@lo:700: 40000000:02000000:0.0:1787394920.961350:0:6608:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1787394921.106001:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787394921.106052:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787394921.106172:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6965:x1874219323371136:12345-0@lo:700: Request processed in 188521us (188633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394921.106190:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787394921.108506:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291b2680 x1874219323371136/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787394936 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394921.108520:0:6965:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787394921.108538:0:6965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371136:0@lo:700: 00000004:02000040:2.0:1787394921.188526:0:6965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787394921.195159:0:6965:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371392:0@lo:5: 00000100:00100000:1.0:1787394921.195242:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394921.195293:0:6965:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787394921.195449:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371392 00000100:00100000:2.0:1787394921.195456:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371392 00000100:00100000:2.0:1787394921.195496:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787394921.195504:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6965:x1874219323371392:12345-0@lo:5: 00002000:00080000:1.0:1787394921.205902:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787394921.205934:0:6602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787394921.217183:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1874219323371392:12345-0@lo:5: Request processed in 21671us (21931us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787394921.217197:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787394921.220245:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa50700 x1874219323371392/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787394937 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394921.220266:0:6965:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1874219323371392:0@lo:5: 00000004:00080000:2.0:1787394921.220281:0:6965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787394921.938855:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394922.962528:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394923.986415:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394925.011380:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787394925.280848:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:3.0:1787394925.651630:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323371520:0@lo:400: 00000100:00100000:3.0:1787394925.651701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394925.651752:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787394925.651758:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323371904:0@lo:400: 00000100:00100000:3.0:1787394925.651800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394925.651832:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323371648:0@lo:400: 00000100:00100000:3.0:1787394925.651858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394925.651876:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787394925.651881:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323371776:0@lo:400: 00000100:00100000:3.0:1787394925.651911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394925.651943:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371520 00000100:00100000:3.0:1787394925.651951:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371520 00000100:00100000:3.0:1787394925.651989:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787394925.651996:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3306:x1874219323371520:12345-0@lo:400: 00000100:00100000:3.0:1787394925.652351:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3306:x1874219323371520:12345-0@lo:400: Request processed in 353us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394925.652359:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787394925.652390:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371904 00000100:00100000:3.0:1787394925.652394:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371904 00000100:00100000:3.0:1787394925.652427:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394925.652433:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323371904:12345-0@lo:400: 00000100:00100000:3.0:1787394925.652464:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323371904:12345-0@lo:400: Request processed in 32us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394925.652471:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787394925.652488:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371648 00000100:00100000:3.0:1787394925.652491:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371648 00000100:00100000:3.0:1787394925.652513:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323371776 00000100:00100000:3.0:1787394925.652515:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323371776 00000100:00100000:3.0:1787394925.652534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787394925.652540:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323371648:12345-0@lo:400: 00000100:00100000:3.0:1787394925.652588:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323371648:12345-0@lo:400: Request processed in 48us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394925.652601:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787394925.652615:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787394925.652621:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323371776:12345-0@lo:400: 00000100:00100000:3.0:1787394925.652650:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323371776:12345-0@lo:400: Request processed in 30us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394925.652656:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787394925.652677:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787394925.652681:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787394925.652715:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a3b80 x1874219323371776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394925.652729:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323371776:0@lo:400: 00010000:00080000:3.0:1787394925.652739:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a1180 x1874219323371648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394925.652748:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323371648:0@lo:400: 00010000:00080000:3.0:1787394925.652776:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291a0700 x1874219323371904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394925.652784:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787394925.652796:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323371904:0@lo:400: 00000100:00100000:3.0:1787394925.652804:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323371520:0@lo:400: 00010000:00010000:3.0:1787394926.036439:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394926.163472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323372032:0@lo:13: 00000100:00100000:3.0:1787394926.163540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394926.165255:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372032 00000100:00100000:3.0:1787394926.165270:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372032 00000100:00100000:3.0:1787394926.165360:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394926.165371:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323372032:12345-0@lo:13: 00002000:00000024:3.0:1787394926.165411:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787394926.165483:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323372032:12345-0@lo:13: Request processed in 115us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394926.165491:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787394926.167091:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b3291b2680 x1874219323372032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394926.167117:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323372032:0@lo:13: 00010000:00010000:3.0:1787394927.059394:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394928.082764:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394929.109191:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787394930.063734:0:7486:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787394930.063738:0:7486:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787394930.063883:0:7486:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0b33f645800 00000020:01000004:2.0:1787394930.063898:0:7486:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787394930.063910:0:7486:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787394930.063922:0:7486:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0b318db99c0) 00000020:00000080:2.0:1787394930.063938:0:7486:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787394930.087645:0:7486:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787394930.088051:0:7486:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787394930.120609:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787394930.125389:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787394930.125428:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787394930.125488:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787394930.125515:0:7486:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787394930.125836:0:7486:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787394930.125847:0:7486:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787394930.125858:0:7486:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedbabbe2e89a7e46 00000020:01000004:0.0:1787394930.125921:0:7486:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787394930.125944:0:7486:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787394930.125948:0:7486:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787394930.125954:0:7486:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787394930.125980:0:7486:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787394930.125985:0:7486:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:3.0:1787394930.130611:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787394930.140250:0:7486:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787394930.140286:0:7486:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.116@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787394930.140290:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787394930.140292:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787394930.140293:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787394930.140294:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787394930.140296:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787394930.140297:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787394930.140299:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787394930.140300:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787394930.140301:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787394930.140303:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787394930.140327:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787394930.140331:0:7486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787394930.140333:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787394930.140335:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787394930.140336:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787394930.140337:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787394930.140337:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787394930.140338:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787394930.140339:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787394930.140340:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787394930.140341:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787394930.140342:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787394930.140344:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787394930.140371:0:7486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787394930.140390:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323372160:0@lo:253: 00000100:00100000:0.0:1787394930.140465:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.140591:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.140636:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372160 00000100:00100000:3.0:1787394930.140645:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372160 00000100:00100000:3.0:1787394930.140726:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787394930.140736:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:7486:x1874219323372160:12345-0@lo:253: 20000000:01000000:3.0:1787394930.140772:0:5795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787394930.140776:0:5795:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787394930.140781:0:5795:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787394930.140784:0:5795:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787394930.141758:0:5795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787394930.141968:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787394930.141980:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787394930.142019:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787394930.142027:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787394930.142071:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787394930.142118:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787394930.142506:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787394930.142525:0:5795:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.116@tcp 20000000:01000000:3.0:1787394930.142527:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.116@tcp (null) (null) (null) 00000040:00080000:3.0:1787394930.142561:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787394930.142578:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787394930.142629:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787394930.142639:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.116@tcp (null) (null) 00000040:00080000:3.0:1787394930.142672:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787394930.142681:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787394930.142714:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787394930.142763:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787394930.144151:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787394930.144176:0:5795:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.116@tcp 20000000:01000000:3.0:1787394930.144178:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.116@tcp (null) (null) (null) 00000040:00080000:3.0:1787394930.144222:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787394930.144230:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787394930.144260:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787394930.144267:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.116@tcp (null) (null) 00000040:00080000:3.0:1787394930.148037:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787394930.148067:0:5795:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787394930.148175:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787394930.148216:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787394930.148240:0:5795:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787394930.148243:0:5795:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787394930.148246:0:5795:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787394930.148257:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787394930.148259:0:5795:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787394930.148321:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787394930.148324:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787394930.148828:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787394930.149223:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787394930.149274:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787394930.149380:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787394930.149399:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787394930.149401:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787394930.149861:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1787394930.149932:0:7489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1787394930.149985:0:7489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787394930.150243:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787394930.150275:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787394930.150375:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787394930.150388:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787394930.150390:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787394930.150924:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787394930.151001:0:7490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787394930.151113:0:7490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787394930.151372:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787394930.151413:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787394930.151467:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787394930.151482:0:5795:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787394930.151484:0:5795:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787394930.151984:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787394930.152039:0:7491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787394930.152091:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787394930.152392:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787394930.152434:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787394930.152468:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787394930.152483:0:5795:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787394930.152485:0:5795:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787394930.152494:0:5795:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787394930.152512:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152530:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152538:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152543:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152549:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152556:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152563:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152599:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152626:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 16 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.152639:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372288:0@lo:104: 00000100:00100000:3.0:1787394930.152696:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394930.152744:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152752:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 16 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.152759:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372416:0@lo:104: 00010000:00010000:3.0:1787394930.152782:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152790:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 16 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.152798:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372544:0@lo:104: 00010000:00010000:3.0:1787394930.152820:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152828:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 16 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.152836:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372672:0@lo:104: 00010000:00010000:3.0:1787394930.152859:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.152890:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 16 pid: 5796 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.152898:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372800:0@lo:104: 00000100:00100000:3.0:1787394930.152918:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.153080:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787394930.153098:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.153124:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.153133:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.153141:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.153151:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372288 00000100:00100000:2.0:1787394930.153157:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372288 00000100:00100000:2.0:1787394930.153185:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372416 00000100:00100000:2.0:1787394930.153188:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372416 00000100:00100000:2.0:1787394930.153197:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372544 00000100:00100000:2.0:1787394930.153199:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372544 00000100:00100000:2.0:1787394930.153208:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372672 00000100:00100000:2.0:1787394930.153210:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372672 00000100:00100000:2.0:1787394930.153218:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372800 00000100:00100000:2.0:1787394930.153220:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372800 00000100:00100000:2.0:1787394930.153230:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787394930.153237:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b329219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:5795:x1874219323372288:12345-0@lo:104: 00010000:00010000:2.0:1787394930.153248:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.153299:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787394930.153323:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b329219850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:5795:x1874219323372288:12345-0@lo:104: Request processed in 69us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.153337:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787394930.153373:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787394930.153380:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5795:x1874219323372416:12345-0@lo:104: 00010000:00010000:2.0:1787394930.153387:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.153416:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787394930.153420:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:5795:x1874219323372416:12345-0@lo:104: Request processed in 42us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.153425:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787394930.153436:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787394930.153442:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:5795:x1874219323372544:12345-0@lo:104: 00010000:00010000:2.0:1787394930.153448:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.153474:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787394930.153479:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:5795:x1874219323372544:12345-0@lo:104: Request processed in 38us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.153484:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787394930.153495:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787394930.153501:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:5795:x1874219323372672:12345-0@lo:104: 00010000:00010000:2.0:1787394930.153507:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.153530:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787394930.153534:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:5795:x1874219323372672:12345-0@lo:104: Request processed in 34us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.153545:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787394930.153557:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787394930.153562:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5795:x1874219323372800:12345-0@lo:104: 00010000:00010000:2.0:1787394930.153570:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.153596:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787394930.153600:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5795:x1874219323372800:12345-0@lo:104: Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.153606:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787394930.153693:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787394930.153699:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153707:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342045000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.153711:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153719:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.153726:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.153732:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394930.153764:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153771:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.153796:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153802:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342045000/0xedbabbe2e89a7e31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e38 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153826:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787394930.153829:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153834:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342045200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.153837:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.153843:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.153849:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.153853:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1787394930.153980:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372288:0@lo:104: 00000100:00100000:0.0:1787394930.153990:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372416:0@lo:104: 00000100:00100000:0.0:1787394930.153997:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372544:0@lo:104: 00000100:00100000:0.0:1787394930.154002:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372672:0@lo:104: 00000100:00100000:0.0:1787394930.154017:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5795:1874219323372800:0@lo:104: 00010000:00010000:0.0:1787394930.154052:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.154075:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1787394930.154094:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787394930.154105:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323372928:0@lo:103: 00000100:00100000:0.0:1787394930.154134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394930.154201:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154208:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.154224:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154232:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342045200/0xedbabbe2e89a7e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e0e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154242:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787394930.154246:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154261:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031c00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.154263:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154270:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.154276:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.154281:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394930.154328:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154335:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.154350:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154356:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031c00/0xedbabbe2e89a7dc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dc8 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154366:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787394930.154369:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154375:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148e800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.154377:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154394:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.154401:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.154406:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394930.154419:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154425:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.154431:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154438:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7d97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d9e expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154449:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.154451:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.154453:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394930.154468:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323373184:0@lo:103: 00000100:00100000:3.0:1787394930.154496:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.154515:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394930.154520:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323373312:0@lo:103: 00000100:00100000:3.0:1787394930.154539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.154570:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323372928 00000100:00100000:3.0:1787394930.154575:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323372928 00010000:00010000:3.0:1787394930.154594:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 17 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.154621:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373184 00000100:00100000:3.0:1787394930.154623:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373184 00010000:00010000:3.0:1787394930.154634:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 18 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.154643:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373312 00000100:00100000:3.0:1787394930.154645:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373312 00010000:00010000:3.0:1787394930.154653:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 19 pid: 5796 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.154665:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787394930.154672:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323372928:12345-0@lo:103: 00010000:00010000:3.0:1787394930.154682:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.154686:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 19 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154696:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 19 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154709:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342166c00/0xedbabbe2e89a7e38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7e31 expref: 19 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154723:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.154747:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:3304:x1874219323372928:12345-0@lo:103: Request processed in 75us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.154753:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787394930.154767:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787394930.154773:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:3305:x1874219323373184:12345-0@lo:103: 00010000:00010000:3.0:1787394930.154788:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.154793:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154800:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154809:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b30148f000/0xedbabbe2e89a7dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7dc1 expref: 17 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.154818:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.154843:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3305:x1874219323373184:12345-0@lo:103: Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.154848:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787394930.154860:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787394930.154965:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323373056:0@lo:103: 00000100:00100000:0.0:1787394930.154989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.155013:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323372928:0@lo:103: 00000100:00100000:3.0:1787394930.155066:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:3305:x1874219323373312:12345-0@lo:103: 00010000:00010000:3.0:1787394930.155075:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.155080:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 15 pid: 5796 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155088:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 15 pid: 5796 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155099:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342045e00/0xedbabbe2e89a7d9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7d97 expref: 15 pid: 5796 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155107:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.155129:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3305:x1874219323373312:12345-0@lo:103: Request processed in 264us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.155136:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787394930.155152:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373056 00000100:00100000:3.0:1787394930.155155:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373056 00010000:00010000:3.0:1787394930.155168:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 14 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.155181:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787394930.155186:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3304:x1874219323373056:12345-0@lo:103: 00010000:00010000:3.0:1787394930.155193:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.155197:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 14 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155206:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 14 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155216:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7e0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7e07 expref: 14 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155227:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.155379:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3304:x1874219323373056:12345-0@lo:103: Request processed in 191us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.155386:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787394930.155413:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323373312:0@lo:103: 00000100:00100000:3.0:1787394930.155421:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323373184:0@lo:103: 00010000:00010000:2.0:1787394930.155646:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394930.155648:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394930.155650:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.155676:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155685:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342044400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.155689:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155707:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.155714:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.155719:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394930.155747:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155753:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.155765:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155772:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342044400/0xedbabbe2e89a7deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7df2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.155790:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.155791:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.155793:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394930.155803:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323373440:0@lo:103: 00000100:00100000:3.0:1787394930.155828:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.155857:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373440 00000100:00100000:3.0:1787394930.155860:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373440 00010000:00010000:3.0:1787394930.155977:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.156039:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787394930.156046:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3303:x1874219323373440:12345-0@lo:103: 00010000:00010000:3.0:1787394930.156060:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.156065:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156074:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156085:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a7df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7deb expref: 13 pid: 5795 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156098:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156106:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156120:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156128:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156136:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156142:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156147:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787394930.156151:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156168:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156183:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.156193:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.156223:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3303:x1874219323373440:12345-0@lo:103: Request processed in 178us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.156230:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787394930.156323:0:5795:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.156332:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.156339:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55dc00/0xedbabbe2e89a7e4d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787394930.156352:0:5795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787394930.156474:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323373056:0@lo:103: 00000100:00100000:3.0:1787394930.156664:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323373440:0@lo:103: 00000100:00100000:3.0:1787394930.202197:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:7486:x1874219323372160:12345-0@lo:253: Request processed in 61454us (61722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.202211:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787394930.202296:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323372160:0@lo:253: 10000000:01000000:0.0:1787394930.202386:0:7486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787394930.202391:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787394930.202392:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787394930.202394:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787394930.202395:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787394930.202396:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787394930.202398:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787394930.202399:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787394930.202401:0:7486:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787394930.202402:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787394930.202403:0:7486:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787394930.202497:0:7486:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b33f645800 from lustre-OST0001 10000000:01000000:2.0:1787394930.202524:0:7486:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787394930.202527:0:7486:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787394930.202535:0:7486:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0b3181099c0 local copy 10000000:01000000:2.0:1787394930.202539:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787394930.202576:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.202588:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.202596:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394930.202615:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373568:0@lo:101: 00000100:00100000:2.0:1787394930.202652:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.202739:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.202782:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373568 00000100:00100000:3.0:1787394930.202789:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373568 00000100:00100000:3.0:1787394930.202924:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787394930.202935:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:7486:x1874219323373568:12345-0@lo:101: 00010000:00010000:3.0:1787394930.202947:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394930.202961:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a7e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e54 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.202983:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a7e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e54 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.202994:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a7e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e54 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.203015:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:3.0:1787394930.203103:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323373568:12345-0@lo:101: Request processed in 169us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.203109:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787394930.203182:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373568:0@lo:101: 00010000:00010000:2.0:1787394930.203195:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203203:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394930.203298:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373696:0@lo:501: 00000100:00100000:2.0:1787394930.203344:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.203408:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.203458:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373696 00000100:00100000:3.0:1787394930.203462:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373696 00000100:00100000:3.0:1787394930.203496:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787394930.203503:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323373696:12345-0@lo:501: 00000100:00100000:3.0:1787394930.203693:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323373696:12345-0@lo:501: Request processed in 190us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787394930.203701:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787394930.203771:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373696:0@lo:501: 10000000:01000000:2.0:1787394930.203785:0:7486:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787394930.203809:0:7486:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787394930.203815:0:7486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203823:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203831:0:7486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203850:0:7486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787394930.203879:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b33f645800 10000000:01000000:2.0:1787394930.203885:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787394930.203890:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787394930.203892:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787394930.203896:0:7486:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787394930.203904:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787394930.203921:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203929:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.203936:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394930.203948:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373824:0@lo:101: 00000100:00100000:2.0:1787394930.203974:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.203988:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912d780 going to sleep for 11 seconds 00010000:00010000:3.0:1787394930.204103:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787394930.204110:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204117:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148f400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787394930.204121:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204130:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787394930.204136:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394930.204142:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787394930.204160:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204177:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787394930.204203:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204210:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148f400/0xedbabbe2e89a7e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xedbabbe2e89a7e5b expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204223:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.204225:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394930.204226:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394930.204233:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787394930.204244:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323373952:0@lo:103: 00000100:00100000:3.0:1787394930.204271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.204299:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373952 00000100:00100000:3.0:1787394930.204303:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373952 00000100:00100000:3.0:1787394930.204363:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394930.204370:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:3303:x1874219323373952:12345-0@lo:103: 00010000:00010000:3.0:1787394930.204379:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787394930.204391:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a7e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7e54 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204405:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787394930.204433:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:3303:x1874219323373952:12345-0@lo:103: Request processed in 63us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.204440:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787394930.204467:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323373952:0@lo:103: 00000100:00100000:3.0:1787394930.204482:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323373824 00000100:00100000:3.0:1787394930.204493:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323373824 00000100:00100000:3.0:1787394930.204510:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787394930.204516:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+11:7486:x1874219323373824:12345-0@lo:101: 00010000:00010000:3.0:1787394930.204524:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394930.204534:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e62 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204550:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204560:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204567:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c800, rc 0) 00000100:00100000:3.0:1787394930.204595:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323373824:12345-0@lo:101: Request processed in 79us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.204602:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787394930.204643:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323373824:0@lo:101: 00010000:00010000:3.0:1787394930.204654:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.204662:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.204721:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374080:0@lo:501: 00000100:00100000:3.0:1787394930.204744:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.204763:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374080 00000100:00100000:3.0:1787394930.204767:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374080 00000100:00100000:3.0:1787394930.204784:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787394930.204796:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374080:12345-0@lo:501: 00000100:00100000:3.0:1787394930.205149:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374080:12345-0@lo:501: Request processed in 353us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.205156:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787394930.205184:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.205196:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374080:0@lo:501: 00000100:00100000:3.0:1787394930.205219:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374208:0@lo:503: 00000100:00100000:3.0:1787394930.205255:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.205345:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787394930.205422:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374208 00000100:00100000:1.0:1787394930.205427:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374208 00000100:00100000:1.0:1787394930.205493:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787394930.205501:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374208:12345-0@lo:503: 00000100:00100000:1.0:1787394930.205648:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374208:12345-0@lo:503: Request processed in 148us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394930.205656:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787394930.205716:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374208:0@lo:503: 00000040:00080000:3.0:1787394930.205968:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787394930.206044:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374336:0@lo:502: 00000100:00100000:3.0:1787394930.206080:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.206243:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394930.206396:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374336 00000100:00100000:0.0:1787394930.206401:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374336 00000100:00100000:0.0:1787394930.206426:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787394930.206433:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374336:12345-0@lo:502: 00000100:00100000:0.0:1787394930.206601:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374336:12345-0@lo:502: Request processed in 168us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394930.206614:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787394930.206692:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374336:0@lo:502: 00000040:00080000:3.0:1787394930.206937:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787394930.206987:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787394930.207023:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787394930.207094:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787394930.207126:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787394930.207152:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787394930.207175:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374464:0@lo:502: 00000100:00100000:3.0:1787394930.207213:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.207246:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394930.207379:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374464 00000100:00100000:0.0:1787394930.207385:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374464 00000100:00100000:0.0:1787394930.207407:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787394930.207413:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374464:12345-0@lo:502: 00000100:00100000:0.0:1787394930.207557:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374464:12345-0@lo:502: Request processed in 144us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394930.207565:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787394930.207641:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374464:0@lo:502: 00000040:00080000:3.0:1787394930.207716:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787394930.207732:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787394930.208538:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787394930.208548:0:7494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787394930.208555:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394930.208557:0:7494:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787394930.208561:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787394930.208586:0:7494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0b3411d3380) 00000020:00000080:3.0:1787394930.208607:0:7494:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787394930.208614:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787394930.208678:0:7494:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b33f645800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787394930.208684:0:7494:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787394930.208691:0:7494:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedbabbe2e89a7e77 00010000:00010000:2.0:1787394930.213121:0:7494:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1787394930.213657:0:7494:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787394930.216761:0:7494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787394930.217106:0:7494:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1787394930.221761:0:7494:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1787394930.222404:0:7494:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787394930.223691:0:7494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787394930.223701:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787394930.223709:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394930.223711:0:7494:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787394930.223715:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787394930.223719:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394930.223721:0:7494:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787394930.223724:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787394930.223726:0:7494:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787394930.223771:0:7494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787394930.223775:0:7494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394930.223776:0:7494:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787394930.223785:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787394930.223990:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1787394930.224011:0:7486:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787394930.224040:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.224052:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394930.224061:0:7486:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f645800 from 1 10000000:01000000:0.0:1787394930.224064:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787394930.224097:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.224106:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.224116:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394930.224139:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374592:0@lo:101: 00000100:00100000:0.0:1787394930.224211:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.224254:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787394930.224339:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374592 00000100:00100000:1.0:1787394930.224346:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374592 00000100:00100000:1.0:1787394930.224385:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787394930.224395:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:7486:x1874219323374592:12345-0@lo:101: 00010000:00010000:1.0:1787394930.224407:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394930.224424:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e7e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.224446:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.224458:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.224467:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166a00, rc 0) 00000100:00100000:1.0:1787394930.224510:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374592:12345-0@lo:101: Request processed in 116us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394930.224517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787394930.224567:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374592:0@lo:101: 00010000:00010000:1.0:1787394930.224580:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.224589:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394930.224669:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374720:0@lo:501: 00000100:00100000:1.0:1787394930.224693:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394930.224705:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3181929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.224813:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374720 00000100:00100000:2.0:1787394930.224817:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374720 00000100:00100000:2.0:1787394930.224850:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787394930.224857:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374720:12345-0@lo:501: 00000100:00100000:2.0:1787394930.225138:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374720:12345-0@lo:501: Request processed in 281us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.225145:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787394930.225208:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374720:0@lo:501: 00000100:00100000:0.0:1787394930.225234:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374848:0@lo:503: 00000100:00100000:0.0:1787394930.225270:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.225297:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.225449:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374848 00000100:00100000:2.0:1787394930.225454:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374848 00000100:00100000:2.0:1787394930.225476:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787394930.225482:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374848:12345-0@lo:503: 00000100:00100000:2.0:1787394930.225749:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374848:12345-0@lo:503: Request processed in 266us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.225756:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787394930.225844:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374848:0@lo:503: 00000040:00080000:0.0:1787394930.226156:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787394930.226212:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374976:0@lo:502: 00000100:00100000:0.0:1787394930.226247:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.226268:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1787394930.226329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323374976 00000100:00100000:1.0:1787394930.226334:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323374976 00000100:00100000:1.0:1787394930.226365:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787394930.226372:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374976:12345-0@lo:502: 00000100:00100000:1.0:1787394930.226514:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323374976:12345-0@lo:502: Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394930.226530:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787394930.226567:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323374976:0@lo:502: 00000040:00080000:1.0:1787394930.226776:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787394930.226820:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787394930.226841:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375104:0@lo:502: 00000100:00100000:1.0:1787394930.227046:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394930.227074:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3181920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394930.227129:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375104 00000100:00100000:0.0:1787394930.227134:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375104 00000100:00100000:0.0:1787394930.227157:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787394930.227162:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323375104:12345-0@lo:502: 00000100:00100000:0.0:1787394930.227302:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323375104:12345-0@lo:502: Request processed in 139us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394930.227332:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787394930.227453:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375104:0@lo:502: 00000040:00080000:1.0:1787394930.227533:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787394930.227542:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787394930.228921:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787394930.228933:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394930.228935:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787394930.228943:0:7497:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b33f645800 00000020:00000080:1.0:1787394930.228945:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787394930.228968:0:7497:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394930.228971:0:7497:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394930.228972:0:7497:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787394930.228975:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787394930.237426:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787394930.237465:0:7486:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787394930.237483:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.237495:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394930.237546:0:7486:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787394930.237550:0:7486:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b33f645800 10000000:01000000:2.0:1787394930.237553:0:7486:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b33f645800 10000000:01000000:2.0:1787394930.237557:0:7486:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787394930.237563:0:7486:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b33f645800 from 1 10000000:01000000:2.0:1787394930.237566:0:7486:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787394930.237606:0:7486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.237614:0:7486:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.237624:0:7486:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394930.237646:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375232:0@lo:101: 00000100:00100000:2.0:1787394930.237711:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.237748:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912d480 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.237785:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375232 00000100:00100000:2.0:1787394930.237792:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375232 00000100:00100000:2.0:1787394930.237831:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787394930.237840:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323375232:12345-0@lo:101: 00010000:00010000:2.0:1787394930.237852:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394930.237863:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7e8c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.237997:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.238008:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.238017:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b30148f800, rc 0) 00000100:00100000:2.0:1787394930.238073:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375232:12345-0@lo:101: Request processed in 233us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.238080:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787394930.238175:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375232:0@lo:101: 00010000:00010000:3.0:1787394930.238189:0:7486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.238196:0:7486:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.238287:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375360:0@lo:501: 00000100:00100000:3.0:1787394930.238344:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.238362:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.238983:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375360 00000100:00100000:2.0:1787394930.238991:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375360 00000100:00100000:2.0:1787394930.239040:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787394930.239048:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375360:12345-0@lo:501: 00000100:00100000:2.0:1787394930.239289:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375360:12345-0@lo:501: Request processed in 240us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.239297:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787394930.239409:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375360:0@lo:501: 00000100:00100000:3.0:1787394930.239442:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375488:0@lo:503: 00000100:00100000:3.0:1787394930.239482:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.239510:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394930.239553:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375488 00000100:00100000:2.0:1787394930.239557:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375488 00000100:00100000:2.0:1787394930.239944:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787394930.239953:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375488:12345-0@lo:503: 00000100:00100000:2.0:1787394930.240118:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375488:12345-0@lo:503: Request processed in 166us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.240125:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787394930.240416:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375488:0@lo:503: 00000040:00080000:0.0:1787394930.240680:0:7486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787394930.240742:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375616:0@lo:502: 00000100:00100000:0.0:1787394930.240784:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.240805:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f69c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.241410:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375616 00000100:00100000:3.0:1787394930.241416:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375616 00000100:00100000:3.0:1787394930.241490:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787394930.241499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375616:12345-0@lo:502: 00000100:00100000:3.0:1787394930.241717:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375616:12345-0@lo:502: Request processed in 219us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.241725:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787394930.241846:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375616:0@lo:502: 00000040:00080000:1.0:1787394930.242175:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787394930.242226:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787394930.242262:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787394930.242340:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787394930.242382:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787394930.242428:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787394930.242464:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787394930.242493:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787394930.242547:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787394930.242582:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787394930.242616:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787394930.242664:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787394930.242695:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787394930.242726:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787394930.242773:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787394930.242808:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787394930.242840:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787394930.242962:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787394930.243001:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787394930.243048:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787394930.243121:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787394930.243156:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787394930.243190:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787394930.243237:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787394930.243275:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787394930.243334:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787394930.243385:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787394930.243422:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787394930.243457:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787394930.243506:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787394930.243543:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787394930.243577:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787394930.243611:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787394930.243656:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787394930.243691:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787394930.243735:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787394930.243786:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787394930.243823:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375744:0@lo:502: 00000100:00100000:1.0:1787394930.244295:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394930.244371:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3181920c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.244446:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375744 00000100:00100000:3.0:1787394930.244454:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375744 00000100:00100000:3.0:1787394930.244502:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787394930.244511:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375744:12345-0@lo:502: 00000100:00100000:3.0:1787394930.244722:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323375744:12345-0@lo:502: Request processed in 211us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.244729:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787394930.244781:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323375744:0@lo:502: 00000040:00080000:3.0:1787394930.244852:0:7486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787394930.244875:0:7486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787394930.245724:0:7499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787394930.245741:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0b3411d19c0) 00000020:00000080:3.0:1787394930.245762:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787394930.245961:0:7499:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b33f645800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787394930.245965:0:7499:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b33f645800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787394930.245968:0:7499:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b33f645800 3 00010000:00080000:3.0:1787394930.245995:0:7499:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b302d9c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1787394930.249543:0:7499:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787394930.249648:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787394930.249685:0:7499:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787394930.249698:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xedbabbe2e89a7ea1 00000100:00080000:3.0:1787394930.249708:0:7499:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787394930.249714:0:7499:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0b302d9c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787394930.249749:0:7499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b33fb55880 x1874219323375872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787394930.249779:0:7499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787394930.249859:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323376000:0@lo:400: 00000100:00100000:2.0:1787394930.249984:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787394930.249996:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323376256:0@lo:400: 00000100:00100000:2.0:1787394930.250066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.250105:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376256 00000100:00100000:2.0:1787394930.250111:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376256 00000100:00100000:2.0:1787394930.250156:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787394930.250165:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323376256:12345-0@lo:400: 00000100:00100000:2.0:1787394930.250214:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323376256:12345-0@lo:400: Request processed in 50us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.250220:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787394930.250235:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787394930.250258:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33fb57800 x1874219323376256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394930.250270:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323376256:0@lo:400: 00000100:00100000:3.0:1787394930.250979:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.251003:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394930.251010:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323376128:0@lo:400: 00000100:00100000:3.0:1787394930.251038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.251171:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376000 00000100:00100000:3.0:1787394930.251176:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376000 00000100:00100000:3.0:1787394930.251214:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376128 00000100:00100000:3.0:1787394930.251217:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376128 00000100:00100000:3.0:1787394930.251243:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787394930.251249:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323376000:12345-0@lo:400: 00000100:00100000:3.0:1787394930.251285:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323376000:12345-0@lo:400: Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.251292:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787394930.251323:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787394930.251329:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323376128:12345-0@lo:400: 00000100:00100000:3.0:1787394930.251357:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323376128:12345-0@lo:400: Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.251363:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787394930.251382:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787394930.251402:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33fb55180 x1874219323376128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394930.251412:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323376128:0@lo:400: 00010000:00080000:3.0:1787394930.251422:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33fb57100 x1874219323376000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394930.251438:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323376000:0@lo:400: 00000100:00100000:1.0:1787394930.252990:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323375872:0@lo:38: 00000100:00100000:1.0:1787394930.253055:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.253170:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323375872 00000100:00100000:3.0:1787394930.253176:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323375872 00000100:00100000:3.0:1787394930.253215:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787394930.253221:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874219323375872:12345-0@lo:38: 00010000:00080000:3.0:1787394930.253244:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1787394930.253288:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xedbabbe2e89a7ea8 00000004:00100000:3.0:1787394930.253302:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787394930.253356:0:5804:0:(import.c:65:import_set_state_nolock()) ffffa0b336752000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787394930.253409:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874219323375872:12345-0@lo:38: Request processed in 187us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.253417:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787394930.253459:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33fb55880 x1874219323375872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787394940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394930.253468:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787394930.253475:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787394930.253482:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787394930.253487:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787394930.253489:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787394930.253495:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323375872:0@lo:38: 00000040:00080000:2.0:1787394930.255471:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787394930.255604:0:7486:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787394930.255626:0:7486:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787394930.255645:0:7486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394930.255658:0:7486:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787394930.255710:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787394930.255712:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787394930.255714:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394930.255715:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394930.255716:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394930.255718:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394930.255719:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394930.255720:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394930.255721:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394930.255723:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394930.255724:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394930.255727:0:7486:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787394930.255730:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787394930.255731:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787394930.255732:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394930.255733:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394930.255734:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394930.255735:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394930.255736:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394930.255737:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394930.255738:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394930.255739:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394930.255740:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787394930.255762:0:7486:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787394930.255780:0:7486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323376384:0@lo:253: 00000100:00100000:1.0:1787394930.255852:0:7486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394930.255888:0:7486:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18900 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.256059:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376384 00000100:00100000:3.0:1787394930.256066:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376384 00000100:00100000:3.0:1787394930.256142:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787394930.256151:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7486:x1874219323376384:12345-0@lo:253: 20000000:01000000:3.0:1787394930.256176:0:5796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787394930.256195:0:5796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787394930.256919:0:7501:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1874219323376512:0@lo:901: 00000100:00100000:3.0:1787394930.256959:0:7501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394930.258088:0:7501:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b322353240 going to sleep for 11 seconds 00000100:00100000:1.0:1787394930.259144:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376512 00000100:00100000:1.0:1787394930.259153:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376512 00000100:00100000:1.0:1787394930.259229:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787394930.259239:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1874219323376512:12345-0@lo:901: 00000100:00100000:1.0:1787394930.259595:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7501:x1874219323376512:12345-0@lo:901: Request processed in 357us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394930.259603:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787394930.259664:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787394930.260193:0:7501:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33fb55880 x1874219323376512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787394946 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394930.260209:0:7501:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7501:1874219323376512:0@lo:901: 20000000:01000000:3.0:1787394930.279886:0:5796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787394930.279907:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787394930.280007:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787394930.280013:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787394930.280055:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.280072:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.280080:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.280114:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394930.280129:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 14 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394930.280143:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323376640:0@lo:104: 00000100:00100000:0.0:1787394930.280208:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394930.280256:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394930.280371:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376640 00000100:00100000:3.0:1787394930.280378:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376640 00000100:00100000:3.0:1787394930.280426:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787394930.280436:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323376640:12345-0@lo:104: 00010000:00010000:3.0:1787394930.280448:0:5786:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394930.280507:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787394930.280514:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:5818:x1874219323376640:12345-0@lo:104: Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.280520:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787394930.280599:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1874219323376640:0@lo:104: 00010000:00010000:1.0:1787394930.280618:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284185:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787394930.284199:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284209:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342044200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1787394930.284213:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284221:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787394930.284228:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787394930.284233:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787394930.284277:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284284:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787394930.284319:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284327:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342044200/0xedbabbe2e89a7df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e00 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284347:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394930.284349:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394930.284351:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394930.284375:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323376768:0@lo:103: 00000100:00100000:2.0:1787394930.284452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394930.284509:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376768 00000100:00100000:2.0:1787394930.284517:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376768 00010000:00010000:2.0:1787394930.284542:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 15 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394930.284570:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787394930.284578:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:3304:x1874219323376768:12345-0@lo:103: 00010000:00010000:2.0:1787394930.284589:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394930.284594:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 15 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284604:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 15 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284617:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7df9 expref: 15 pid: 5797 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284631:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284639:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787394930.284656:0:5788:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004643918s 00010000:00010000:2.0:1787394930.284660:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284666:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284683:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284689:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284694:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787394930.284698:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284705:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284720:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284730:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787394930.284764:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3304:x1874219323376768:12345-0@lo:103: Request processed in 186us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394930.284770:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787394930.284824:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323376768:0@lo:103: 00010000:00010000:2.0:1787394930.284853:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284862:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394930.284882:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030600/0xedbabbe2e89a7eaf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394930.286966:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:7486:x1874219323376384:12345-0@lo:253: Request processed in 30809us (31106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394930.286980:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787394930.287066:0:7486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7486:1874219323376384:0@lo:253: 10000000:01000000:1.0:1787394930.287080:0:7486:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787394930.287083:0:7486:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787394930.287085:0:7486:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787394930.287086:0:7486:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787394930.287088:0:7486:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787394930.287089:0:7486:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787394930.287090:0:7486:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787394930.287092:0:7486:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787394930.287093:0:7486:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787394930.287094:0:7486:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787394930.287096:0:7486:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787394930.287097:0:7486:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787394930.287110:0:7486:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787394930.291637:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394930.291834:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787394930.292389:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394930.292566:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787394930.292750:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787394930.293198:0:7486:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787394930.294152:0:7486:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787394930.533203:0:7486:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787394930.533210:0:7486:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787394930.533241:0:7486:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787394930.533506:0:7486:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787394930.533528:0:7486:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787394930.533557:0:7486:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787394931.154427:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394931.282785:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323376896:0@lo:13: 00000100:00100000:1.0:1787394931.282866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394931.282943:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323376896 00000100:00100000:1.0:1787394931.282950:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323376896 00000100:00100000:1.0:1787394931.283272:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787394931.283283:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323376896:12345-0@lo:13: 00002000:00000024:1.0:1787394931.283335:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394931.283391:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323376896:12345-0@lo:13: Request processed in 110us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394931.283398:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787394931.283440:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa53800 x1874219323376896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394931.283458:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323376896:0@lo:13: 00010000:00010000:3.0:1787394932.179428:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394933.203150:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394934.226515:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394935.250398:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394935.380919:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787394935.380943:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323377024:0@lo:400: 00000100:00100000:2.0:1787394935.380953:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323377152:0@lo:400: 00000100:00100000:3.0:1787394935.381013:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323377536:0@lo:400: 00000100:00100000:1.0:1787394935.381094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394935.381135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394935.381141:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323377408:0@lo:400: 00000100:00100000:2.0:1787394935.381156:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394935.381161:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323377280:0@lo:400: 00000100:00100000:1.0:1787394935.381165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394935.381181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394935.381349:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377024 00000100:00100000:0.0:1787394935.381357:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377024 00000100:00100000:0.0:1787394935.381399:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787394935.381408:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3305:x1874219323377024:12345-0@lo:400: 00000100:00100000:0.0:1787394935.381460:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:3305:x1874219323377024:12345-0@lo:400: Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394935.381467:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787394935.381515:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323377024:0@lo:400: 00000100:00100000:3.0:1787394935.381772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394935.381865:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377152 00000100:00100000:0.0:1787394935.381870:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377152 00000100:00100000:0.0:1787394935.381904:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377280 00000100:00100000:0.0:1787394935.381915:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377280 00000100:00100000:0.0:1787394935.381941:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377536 00000100:00100000:0.0:1787394935.381944:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377536 00000100:00100000:0.0:1787394935.381959:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787394935.381965:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323377152:12345-0@lo:400: 00000100:00100000:1.0:1787394935.382089:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394935.382099:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323377280:12345-0@lo:400: 00000100:00100000:1.0:1787394935.382138:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323377280:12345-0@lo:400: Request processed in 41us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394935.382155:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394935.382169:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394935.382174:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323377536:12345-0@lo:400: 00000100:00100000:1.0:1787394935.382209:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323377536:12345-0@lo:400: Request processed in 35us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394935.382214:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787394935.382242:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b3b80 x1874219323377280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394935.382253:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323377280:0@lo:400: 00000100:00100000:0.0:1787394935.382332:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323377152:12345-0@lo:400: Request processed in 366us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394935.382340:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787394935.382357:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787394935.382417:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b2300 x1874219323377152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394935.382427:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323377152:0@lo:400: 00000100:00100000:3.0:1787394935.382490:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377408 00000100:00100000:3.0:1787394935.382494:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377408 00000100:00100000:3.0:1787394935.382588:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787394935.382595:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323377408:12345-0@lo:400: 00000100:00100000:3.0:1787394935.382656:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323377408:12345-0@lo:400: Request processed in 61us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394935.382663:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787394935.382715:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b0700 x1874219323377408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394935.382726:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323377408:0@lo:400: 00010000:00080000:3.0:1787394935.382759:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b2680 x1874219323377536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394935.382769:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323377536:0@lo:400: 00000100:00080000:0.0:1787394935.383445:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787394936.278179:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787394936.325225:0:7842:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1787394936.406385:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787394936.406410:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323377664:0@lo:13: 00000100:00100000:2.0:1787394936.406476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394936.406594:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377664 00000100:00100000:1.0:1787394936.406602:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377664 00000100:00100000:1.0:1787394936.406643:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787394936.406652:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323377664:12345-0@lo:13: 00002000:00000024:1.0:1787394936.406683:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394936.406730:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323377664:12345-0@lo:13: Request processed in 78us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.406737:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787394936.406779:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b3800 x1874219323377664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394936.406797:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323377664:0@lo:13: 10000000:01000000:0.0:1787394936.915966:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787394936.915974:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b305de9800 from 30 10000000:01000000:0.0:1787394936.915978:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787394936.916033:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.916045:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.916056:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.916084:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323377792:0@lo:101: 00000100:00100000:0.0:1787394936.916153:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.916208:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394936.917938:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377792 00000100:00100000:2.0:1787394936.917953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377792 00000100:00100000:2.0:1787394936.918023:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787394936.918033:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323377792:12345-0@lo:101: 00010000:00010000:2.0:1787394936.918047:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394936.918063:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7eb6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394936.918089:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394936.918100:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394936.918107:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48000, rc 0) 00000100:00100000:2.0:1787394936.918200:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323377792:12345-0@lo:101: Request processed in 169us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394936.918208:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787394936.918263:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323377792:0@lo:101: 00010000:00010000:2.0:1787394936.918280:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394936.918289:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394936.918366:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323377920:0@lo:501: 00000100:00100000:2.0:1787394936.918398:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394936.918424:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b305c9f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787394936.918435:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323377920 00000100:00100000:2.0:1787394936.918439:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323377920 00000100:00100000:2.0:1787394936.918473:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787394936.918481:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323377920:12345-0@lo:501: 00000100:00100000:2.0:1787394936.919653:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323377920:12345-0@lo:501: Request processed in 1168us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394936.919664:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787394936.919952:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323377920:0@lo:501: 00000100:00100000:3.0:1787394936.920008:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378048:0@lo:503: 00000100:00100000:3.0:1787394936.920050:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394936.920088:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388900 going to sleep for 11 seconds 00000100:00100000:2.0:1787394936.920132:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378048 00000100:00100000:2.0:1787394936.920139:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378048 00000100:00100000:2.0:1787394936.920174:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787394936.920182:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323378048:12345-0@lo:503: 00000100:00100000:2.0:1787394936.920629:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323378048:12345-0@lo:503: Request processed in 446us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394936.920636:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787394936.934041:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378048:0@lo:503: 00000100:00100000:2.0:1787394936.960069:0:7870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7870:1874219323378176:0@lo:502: 00000100:00100000:2.0:1787394936.960193:0:7870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394936.960267:0:7870:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787394936.960392:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378176 00000100:00100000:3.0:1787394936.960400:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378176 00000100:00100000:3.0:1787394936.960442:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787394936.960452:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7870:x1874219323378176:12345-0@lo:502: 00000100:00100000:3.0:1787394936.961069:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7870:x1874219323378176:12345-0@lo:502: Request processed in 617us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394936.961094:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787394936.961254:0:7870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7870:1874219323378176:0@lo:502: 00000100:00100000:1.0:1787394936.961926:0:7870:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7870:1874219323378304:0@lo:502: 00000100:00100000:1.0:1787394936.961976:0:7870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394936.967937:0:7870:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.973382:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378304 00000100:00100000:0.0:1787394936.973399:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378304 00000100:00100000:0.0:1787394936.973478:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787394936.973491:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7870:x1874219323378304:12345-0@lo:502: 00000100:00100000:0.0:1787394936.973802:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:7870:x1874219323378304:12345-0@lo:502: Request processed in 313us (11824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.973817:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787394936.973865:0:7870:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7870:1874219323378304:0@lo:502: 00000040:00080000:1.0:1787394936.973901:0:7870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787394936.974099:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787394936.974119:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787394936.974130:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394936.974142:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394936.974151:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787394936.974154:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787394936.974156:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787394936.974188:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394936.974197:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394936.974205:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394936.974224:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378432:0@lo:101: 00000100:00100000:3.0:1787394936.974259:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394936.974292:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388240 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.974373:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378432 00000100:00100000:0.0:1787394936.974379:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378432 00000100:00100000:0.0:1787394936.974405:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787394936.974413:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323378432:12345-0@lo:101: 00010000:00010000:0.0:1787394936.974422:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394936.974433:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7ec4 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.974453:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.974463:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.974472:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300031a00, rc 0) 00000100:00100000:0.0:1787394936.974519:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323378432:12345-0@lo:101: Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.974525:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787394936.974677:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378432:0@lo:101: 00010000:00010000:3.0:1787394936.974688:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394936.974697:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394936.974744:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378560:0@lo:501: 00000100:00100000:3.0:1787394936.974779:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394936.974809:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388240 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.974848:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378560 00000100:00100000:0.0:1787394936.974852:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378560 00000100:00100000:0.0:1787394936.974880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787394936.974886:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323378560:12345-0@lo:501: 00000100:00100000:0.0:1787394936.975107:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323378560:12345-0@lo:501: Request processed in 221us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.975115:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787394936.975172:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb55180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378560:0@lo:501: 00000100:00100000:1.0:1787394936.975196:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378688:0@lo:503: 00000100:00100000:1.0:1787394936.975226:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394936.975247:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.975282:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378688 00000100:00100000:0.0:1787394936.975286:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378688 00000100:00100000:1.0:1787394936.975371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787394936.975378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323378688:12345-0@lo:503: 00000100:00100000:1.0:1787394936.975662:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323378688:12345-0@lo:503: Request processed in 284us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.975668:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787394936.975707:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323378688:0@lo:503: 00000100:00100000:3.0:1787394936.978888:0:7874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7874:1874219323378816:0@lo:502: 00000100:00100000:3.0:1787394936.978990:0:7874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394936.979029:0:7874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787394936.979074:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378816 00000100:00100000:1.0:1787394936.979090:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378816 00000100:00100000:1.0:1787394936.979137:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787394936.979146:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:7874:x1874219323378816:12345-0@lo:502: 00000100:00100000:1.0:1787394936.979449:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:7874:x1874219323378816:12345-0@lo:502: Request processed in 303us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.979457:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787394936.979567:0:7874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7874:1874219323378816:0@lo:502: 00000020:01000000:2.0:1787394936.979596:0:7874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787394936.979605:0:7874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394936.979608:0:7874:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787394936.979614:0:7874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787394936.979616:0:7874:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787394936.979637:0:7874:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7874:1874219323378944:0@lo:502: 00000100:00100000:2.0:1787394936.979672:0:7874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394936.979702:0:7874:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787394936.986690:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323378944 00000100:00100000:3.0:1787394936.986706:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323378944 00000100:00100000:3.0:1787394936.986770:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787394936.986780:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:7874:x1874219323378944:12345-0@lo:502: 00000100:00100000:3.0:1787394936.987060:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:7874:x1874219323378944:12345-0@lo:502: Request processed in 281us (7385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394936.987068:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787394936.987275:0:7874:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7874:1874219323378944:0@lo:502: 00000020:01000000:1.0:1787394936.987332:0:7874:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394936.987345:0:7874:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394936.987347:0:7874:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787394936.987356:0:7874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787394936.988096:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787394936.988119:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787394936.988131:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.988143:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394936.988153:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787394936.988155:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b318a89000 from 30 10000000:01000000:0.0:1787394936.988158:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787394936.988189:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.988197:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.988207:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.988227:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379072:0@lo:101: 00000100:00100000:0.0:1787394936.988291:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.988352:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787394936.988819:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379072 00000100:00100000:1.0:1787394936.988826:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379072 00000100:00100000:1.0:1787394936.988867:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787394936.988874:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323379072:12345-0@lo:101: 00010000:00010000:1.0:1787394936.988886:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394936.988897:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7ed2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394936.988919:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394936.988928:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394936.988936:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167e00, rc 0) 00000100:00100000:1.0:1787394936.988970:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323379072:12345-0@lo:101: Request processed in 97us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.988976:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787394936.989336:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379072:0@lo:101: 00010000:00010000:0.0:1787394936.989352:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.989361:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.989423:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379200:0@lo:501: 00000100:00100000:0.0:1787394936.989452:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.989478:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394936.989534:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379200 00000100:00100000:3.0:1787394936.989538:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379200 00000100:00100000:3.0:1787394936.989563:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787394936.989569:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323379200:12345-0@lo:501: 00000100:00100000:3.0:1787394936.989846:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323379200:12345-0@lo:501: Request processed in 277us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394936.989853:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787394936.990614:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379200:0@lo:501: 00000100:00100000:2.0:1787394936.990650:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379328:0@lo:503: 00000100:00100000:2.0:1787394936.990694:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394936.990722:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.991938:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379328 00000100:00100000:0.0:1787394936.991948:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379328 00000100:00100000:0.0:1787394936.992003:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787394936.992013:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323379328:12345-0@lo:503: 00000100:00100000:0.0:1787394936.992226:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323379328:12345-0@lo:503: Request processed in 214us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.992233:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787394936.992285:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379328:0@lo:503: 00000100:00100000:0.0:1787394936.994684:0:7876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7876:1874219323379456:0@lo:502: 00000100:00100000:0.0:1787394936.994774:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394936.994852:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379456 00000100:00100000:1.0:1787394936.994860:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379456 00000100:00100000:1.0:1787394936.994904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787394936.994912:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:7876:x1874219323379456:12345-0@lo:502: 00000100:00100000:1.0:1787394936.995166:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:7876:x1874219323379456:12345-0@lo:502: Request processed in 254us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.995201:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787394936.995225:0:7876:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.995245:0:7876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7876:1874219323379456:0@lo:502: 00000100:00100000:0.0:1787394936.995288:0:7876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7876:1874219323379584:0@lo:502: 00000100:00100000:0.0:1787394936.995334:0:7876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.995354:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379584 00000100:00100000:0.0:1787394936.995357:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379584 00000100:00100000:0.0:1787394936.995373:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787394936.995379:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:7876:x1874219323379584:12345-0@lo:502: 00000100:00100000:0.0:1787394936.995503:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:7876:x1874219323379584:12345-0@lo:502: Request processed in 124us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.995510:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787394936.995547:0:7876:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.995560:0:7876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7876:1874219323379584:0@lo:502: 00000040:00080000:0.0:1787394936.995577:0:7876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787394936.995637:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787394936.995654:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787394936.995664:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995674:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394936.995684:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787394936.995686:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b318a89000 from 5 10000000:01000000:0.0:1787394936.995689:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787394936.995714:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995722:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995732:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.995744:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379712:0@lo:101: 00000100:00100000:0.0:1787394936.995770:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.995783:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.995795:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379712 00000100:00100000:0.0:1787394936.995798:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379712 00000100:00100000:0.0:1787394936.995815:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787394936.995821:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323379712:12345-0@lo:101: 00010000:00010000:0.0:1787394936.995835:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394936.995848:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300031c00/0xedbabbe2e89a7ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7ee0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995867:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300031c00/0xedbabbe2e89a7ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ee0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995876:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300031c00/0xedbabbe2e89a7ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ee0 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995884:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300031c00, rc 0) 00000100:00100000:0.0:1787394936.995912:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323379712:12345-0@lo:101: Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.995917:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787394936.995944:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379712:0@lo:101: 00010000:00010000:0.0:1787394936.995954:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.995962:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.996015:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379840:0@lo:256: 00000100:00100000:0.0:1787394936.996042:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.996054:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d939c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.996065:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379840 00000100:00100000:0.0:1787394936.996068:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379840 00000100:00100000:0.0:1787394936.996084:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787394936.996090:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323379840:12345-0@lo:256: 20000000:01000000:0.0:1787394936.996110:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787394936.996127:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787394936.996129:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787394936.996194:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323379840:12345-0@lo:256: Request processed in 104us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.996200:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787394936.996226:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379840:0@lo:256: 10000000:01000000:0.0:1787394936.996261:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787394936.996266:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996274:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394936.996281:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787394936.996283:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787394936.996285:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787394936.996299:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996328:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996336:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394936.996347:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379968:0@lo:101: 00000100:00100000:0.0:1787394936.996370:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.996383:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787394936.996399:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323379968 00000100:00100000:0.0:1787394936.996403:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323379968 00000100:00100000:0.0:1787394936.996421:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787394936.996427:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323379968:12345-0@lo:101: 00010000:00010000:0.0:1787394936.996434:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394936.996445:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7eee expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996460:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996888:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394936.996896:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030800, rc 0) 00000100:00100000:0.0:1787394936.996939:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323379968:12345-0@lo:101: Request processed in 512us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394936.996945:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787394936.997040:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323379968:0@lo:101: 00010000:00010000:1.0:1787394936.997058:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394936.997188:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394936.997245:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323380096:0@lo:501: 00000100:00100000:1.0:1787394936.997272:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394936.997298:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787394936.997335:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380096 00000100:00100000:1.0:1787394936.997339:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380096 00000100:00100000:1.0:1787394936.997365:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787394936.997479:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323380096:12345-0@lo:501: 00000100:00100000:1.0:1787394936.997717:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323380096:12345-0@lo:501: Request processed in 345us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394936.997724:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787394936.998427:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323380096:0@lo:501: 00000100:00100000:0.0:1787394936.998480:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323380224:0@lo:503: 00000100:00100000:0.0:1787394936.998527:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394936.998582:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787394936.998641:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380224 00000100:00100000:1.0:1787394936.998647:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380224 00000100:00100000:1.0:1787394936.999693:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787394936.999704:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323380224:12345-0@lo:503: 00000100:00100000:1.0:1787394937.000075:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323380224:12345-0@lo:503: Request processed in 371us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.000082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787394937.010970:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323380224:0@lo:503: 00000100:00100000:3.0:1787394937.016422:0:7877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7877:1874219323380352:0@lo:502: 00000100:00100000:3.0:1787394937.016506:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394937.016549:0:7877:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388240 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.016608:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380352 00000100:00100000:1.0:1787394937.016615:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380352 00000100:00100000:1.0:1787394937.016659:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787394937.016669:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:7877:x1874219323380352:12345-0@lo:502: 00000100:00100000:1.0:1787394937.017044:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:7877:x1874219323380352:12345-0@lo:502: Request processed in 376us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.017052:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787394937.018549:0:7877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb56680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7877:1874219323380352:0@lo:502: 00000020:01000000:3.0:1787394937.018592:0:7877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787394937.018607:0:7877:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787394937.018615:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394937.018618:0:7877:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787394937.018623:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787394937.018627:0:7877:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:3.0:1787394937.018650:0:7877:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787394937.018653:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787394937.018667:0:7877:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0b3411d0000) 00000020:00000080:3.0:1787394937.018689:0:7877:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787394937.018696:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787394937.018767:0:7877:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787394937.018771:0:7877:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787394937.018787:0:7877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a7f03 00010000:00080000:3.0:1787394937.018814:0:7877:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b318da1800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1787394937.019068:0:7877:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787394937.019437:0:7877:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787394937.019451:0:7877:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787394937.019968:0:7877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394937.021446:0:7877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787394937.021516:0:7877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787394937.021575:0:7877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787394937.028392:0:7879:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787394937.028401:0:7879:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787394937.030154:0:7877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787394937.030170:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787394937.030201:0:7877:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787394937.030220:0:7877:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a7f0a 00000100:00080000:0.0:1787394937.030231:0:7877:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787394937.030243:0:7877:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b318da1800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787394937.030277:0:7877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b3367bdf80 x1874219323380480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787394937.030490:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323380480:0@lo:8: 00000100:00100000:3.0:1787394937.030554:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787394937.030687:0:7877:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787394937.030818:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787394937.030828:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323380608:0@lo:400: 00000100:00100000:1.0:1787394937.030858:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.030887:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380608 00000100:00100000:1.0:1787394937.030893:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380608 00000100:00100000:1.0:1787394937.030930:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394937.030938:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323380608:12345-0@lo:400: 00000100:00100000:1.0:1787394937.031001:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323380608:12345-0@lo:400: Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.031009:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787394937.031044:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa51880 x1874219323380608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394937.031057:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323380608:0@lo:400: 00000020:01000000:1.0:1787394937.031113:0:7877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394937.031118:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394937.031120:0:7877:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787394937.031124:0:7877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787394937.031127:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394937.031129:0:7877:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787394937.031132:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787394937.031139:0:7877:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787394937.031163:0:7877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7877:1874219323380992:0@lo:502: 00000100:00100000:1.0:1787394937.031206:0:7877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.031226:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380992 00000100:00100000:1.0:1787394937.031230:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380992 00000100:00100000:1.0:1787394937.031254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787394937.031262:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:7877:x1874219323380992:12345-0@lo:502: 00000100:00100000:1.0:1787394937.031511:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:7877:x1874219323380992:12345-0@lo:502: Request processed in 249us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.031518:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787394937.031555:0:7877:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0180 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.031568:0:7877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:7877:1874219323380992:0@lo:502: 00000020:01000000:1.0:1787394937.031589:0:7877:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394937.031593:0:7877:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394937.031595:0:7877:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787394937.031599:0:7877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787394937.031645:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787394937.031661:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787394937.031670:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394937.031681:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394937.031692:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787394937.031694:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0b3181099c0 from 1 10000000:01000000:1.0:1787394937.031697:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787394937.031719:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394937.031739:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394937.031748:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394937.031760:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323381120:0@lo:101: 00000100:00100000:1.0:1787394937.031788:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.031801:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787394937.033556:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323380736:0@lo:400: 00000100:00100000:3.0:1787394937.033620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394937.033663:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394937.033671:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323380864:0@lo:400: 00000100:00100000:3.0:1787394937.033696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394937.033739:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380736 00000100:00100000:3.0:1787394937.033745:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380736 00000100:00100000:3.0:1787394937.033791:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380864 00000100:00100000:3.0:1787394937.033795:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380864 00000100:00100000:3.0:1787394937.033815:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787394937.033835:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323380736:12345-0@lo:400: 00000100:00100000:3.0:1787394937.033886:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323380736:12345-0@lo:400: Request processed in 51us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394937.033893:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787394937.033910:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787394937.033916:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323380864:12345-0@lo:400: 00000100:00100000:3.0:1787394937.033938:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323380864:12345-0@lo:400: Request processed in 24us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394937.033944:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787394937.033978:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa50a80 x1874219323380864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394937.034003:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323380864:0@lo:400: 00010000:00080000:3.0:1787394937.034015:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa50e00 x1874219323380736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394937.034024:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323380736:0@lo:400: 00000100:00080000:0.0:1787394937.034253:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787394937.034265:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381120 00000100:00100000:0.0:1787394937.034269:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381120 00000100:00100000:0.0:1787394937.034301:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787394937.034328:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323381120:12345-0@lo:101: 00010000:00010000:0.0:1787394937.034338:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394937.034368:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7f11 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394937.034394:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394937.034406:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394937.034415:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010200, rc 0) 00000100:00100000:0.0:1787394937.034453:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323381120:12345-0@lo:101: Request processed in 126us (2663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394937.034459:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787394937.034494:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323381120:0@lo:101: 00010000:00010000:0.0:1787394937.034510:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394937.034520:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394937.034585:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323381248:0@lo:501: 00000100:00100000:0.0:1787394937.034611:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394937.034628:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8840 going to sleep for 11 seconds 00000100:00100000:0.0:1787394937.034639:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381248 00000100:00100000:0.0:1787394937.034642:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381248 00000100:00100000:0.0:1787394937.034660:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787394937.034666:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323381248:12345-0@lo:501: 00000100:00100000:0.0:1787394937.034868:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323381248:12345-0@lo:501: Request processed in 201us (256us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787394937.034875:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787394937.034901:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323381248:0@lo:501: 10000000:01000000:0.0:1787394937.034922:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787394937.034928:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394937.034937:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394937.035508:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323380480 00000100:00100000:2.0:1787394937.035514:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323380480 00000100:00100000:2.0:1787394937.035550:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787394937.035556:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323380480:12345-0@lo:8: 00010000:00080000:2.0:1787394937.035589:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1787394937.035616:0:6599:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a7f1f 00002000:00100000:2.0:1787394937.035630:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0b33fb4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787394937.035635:0:6599:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1787394937.035638:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787394937.035740:0:6599:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787394937.035895:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787394937.035920:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787394937.035996:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874219323380480:12345-0@lo:8: Request processed in 438us (5441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394937.036003:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787394937.036195:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bdf80 x1874219323380480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787394947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394937.036206:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787394937.036212:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787394937.036220:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787394937.036224:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787394937.036227:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b318da1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787394937.036256:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787394937.036263:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323380480:0@lo:8: 00000004:00080000:2.0:1787394937.041586:0:7879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787394937.047401:0:7879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 208996091542ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787394937.071435:0:7880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787394937.071465:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381504:0@lo:7: 00000100:00100000:3.0:1787394937.071529:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394937.071555:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2033886c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.072478:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381504 00000100:00100000:1.0:1787394937.072488:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381504 00000100:00100000:1.0:1787394937.072543:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787394937.072552:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7880:x1874219323381504:12345-0@lo:7: 00000100:00100000:3.0:1787394937.074268:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1787394937.074397:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787394937.074622:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323381376:0@lo:13: 00000100:00100000:3.0:1787394937.074680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394937.074754:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381376 00000100:00100000:0.0:1787394937.074761:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381376 00000100:00100000:0.0:1787394937.074796:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787394937.074803:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323381376:12345-0@lo:13: 00002000:00000024:0.0:1787394937.074828:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787394937.074868:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323381376:12345-0@lo:13: Request processed in 65us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394937.074874:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787394937.074956:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fb54e00 x1874219323381376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394937.074973:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323381376:0@lo:13: 00002000:00080000:1.0:1787394937.086284:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787394937.086293:0:6602:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787394937.086408:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7880:x1874219323381504:12345-0@lo:7: Request processed in 13852us (14874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.086421:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787394937.086475:0:7880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fb54a80 x1874219323381504/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787394953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394937.086490:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381504:0@lo:7: 00000004:00080000:1.0:1787394937.086504:0:7880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787394937.086539:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381632:0@lo:5: 00000100:00100000:1.0:1787394937.086572:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.086602:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33674ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.086618:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381632 00000100:00100000:1.0:1787394937.086631:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381632 00000100:00100000:1.0:1787394937.086668:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787394937.086676:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7880:x1874219323381632:12345-0@lo:5: 00002000:00080000:1.0:1787394937.086698:0:6601:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787394937.086701:0:6601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787394937.086893:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7880:x1874219323381632:12345-0@lo:5: Request processed in 217us (319us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787394937.086900:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787394937.087103:0:7880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa50380 x1874219323381632/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787394953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394937.087116:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381632:0@lo:5: 00000004:00080000:0.0:1787394937.087125:0:7880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787394937.087150:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381760:0@lo:700: 00000100:00100000:0.0:1787394937.087178:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394937.087199:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.087428:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381760 00000100:00100000:1.0:1787394937.087433:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381760 00000100:00100000:1.0:1787394937.087469:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787394937.087476:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7880:x1874219323381760:12345-0@lo:700: 00000100:00100000:1.0:1787394937.087503:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6608:1874219323381888:0@lo:700: 00000100:00100000:1.0:1787394937.087531:0:6608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.087548:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33674e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787394937.087566:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323381888 00000100:00100000:1.0:1787394937.087569:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323381888 00000100:00100000:1.0:1787394937.087594:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787394937.087601:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6608:x1874219323381888:12345-0@lo:700: 00000004:00080000:3.0:1787394937.173991:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787394937.261650:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787394937.272494:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6608:x1874219323381888:12345-0@lo:700: Request processed in 184885us (184954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394937.272507:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787394937.273578:0:6608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa52a00 x1874219323381888/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787394953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394937.273596:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6608:1874219323381888:0@lo:700: 40000000:02000000:1.0:1787394937.273609:0:6608:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:3.0:1787394937.305213:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787394937.431414:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787394937.431432:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787394937.435282:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7880:x1874219323381760:12345-0@lo:700: Request processed in 347797us (348094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394937.435297:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787394937.435508:0:7880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bdf80 x1874219323381760/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787394953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394937.435531:0:7880:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787394937.435547:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323381760:0@lo:700: 00000004:02000040:1.0:1787394937.507171:0:7880:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787394937.516096:0:7880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323382016:0@lo:5: 00000100:00100000:1.0:1787394937.516157:0:7880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394937.516199:0:7880:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33674eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394937.516262:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382016 00000100:00100000:3.0:1787394937.516269:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382016 00000100:00100000:3.0:1787394937.516354:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787394937.516363:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7880:x1874219323382016:12345-0@lo:5: 00002000:00080000:0.0:1787394937.525240:0:6601:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787394937.525261:0:6601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787394937.537395:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7880:x1874219323382016:12345-0@lo:5: Request processed in 21022us (21226us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787394937.537410:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787394937.537599:0:7880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa50380 x1874219323382016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787394953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394937.537617:0:7880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7880:1874219323382016:0@lo:5: 00000004:00080000:0.0:1787394937.537629:0:7880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787394938.322583:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394939.346416:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394940.370517:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787394941.095084:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1787394941.394552:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394941.525673:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787394941.526007:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323382144:0@lo:13: 00000100:00100000:1.0:1787394941.526067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394941.526163:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382144 00000100:00100000:2.0:1787394941.526171:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382144 00000100:00100000:2.0:1787394941.526228:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787394941.526236:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323382144:12345-0@lo:13: 00002000:00000024:2.0:1787394941.526266:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394941.526334:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323382144:12345-0@lo:13: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.526341:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787394941.526380:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa52680 x1874219323382144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394941.526396:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323382144:0@lo:13: 00000100:00080000:1.0:1787394941.526451:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787394941.531909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.532182:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304484992 00000100:00100000:2.0:1787394941.532192:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304484992 00000100:00100000:2.0:1787394941.532235:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:2.0:1787394941.532243:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2362:x1874219304484992:12345-192.168.203.16@tcp:250: 00010000:00080000:2.0:1787394941.532269:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c0257003-6b52-426f-9d71-ce21fcfcd00e@192.168.203.16@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1787394941.532297:0:5795:0:(genops.c:1406:class_connect()) connect: client c0257003-6b52-426f-9d71-ce21fcfcd00e, cookie 0xedbabbe2e89a7f26 00000100:00080000:2.0:1787394941.532444:0:5795:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb48000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787394941.532511:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+5:2362:x1874219304484992:12345-192.168.203.16@tcp:250: Request processed in 267us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.532530:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:3.0:1787394941.533994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394941.534132:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485120 00000100:00100000:0.0:1787394941.534140:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485120 00000100:00100000:0.0:1787394941.534190:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00100000:0.0:1787394941.534198:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+5:5565:x1874219304485120:12345-192.168.203.16@tcp:101: 00010000:00010000:0.0:1787394941.534213:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394941.534231:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc208d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394941.534256:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394941.534267:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394941.534275:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010800, rc 0) 00000100:00100000:0.0:1787394941.534337:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+6:5565:x1874219304485120:12345-192.168.203.16@tcp:101: Request processed in 139us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394941.534344:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00100000:2.0:1787394941.535676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394941.535800:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485248 00000100:00100000:3.0:1787394941.535808:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485248 00000100:00100000:3.0:1787394941.535855:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00100000:3.0:1787394941.535864:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+6:5565:x1874219304485248:12345-192.168.203.16@tcp:501: 00000100:00100000:3.0:1787394941.536174:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+6:5565:x1874219304485248:12345-192.168.203.16@tcp:501: Request processed in 310us (503us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787394941.536182:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00100000:1.0:1787394941.538531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.538603:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485376 00000100:00100000:2.0:1787394941.538613:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485376 00000100:00100000:2.0:1787394941.538659:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 113 00000100:00100000:2.0:1787394941.538668:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+6:5565:x1874219304485376:12345-192.168.203.16@tcp:101: 00010000:00010000:2.0:1787394941.538682:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394941.538765:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2094 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.538803:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.538814:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.538823:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787394941.538880:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+7:5565:x1874219304485376:12345-192.168.203.16@tcp:101: Request processed in 213us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.538888:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 113 00000100:00100000:3.0:1787394941.542076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.542155:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485504 00000100:00100000:2.0:1787394941.542166:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485504 00000100:00100000:2.0:1787394941.542218:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:2.0:1787394941.542227:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+7:5565:x1874219304485504:12345-192.168.203.16@tcp:501: 00000100:00100000:2.0:1787394941.542492:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5565:x1874219304485504:12345-192.168.203.16@tcp:501: Request processed in 265us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.542500:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:1.0:1787394941.553130:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.553249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485632 00000100:00100000:2.0:1787394941.553258:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485632 00000100:00100000:2.0:1787394941.553320:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:2.0:1787394941.553331:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5565:x1874219304485632:12345-192.168.203.16@tcp:503: 00000100:00100000:2.0:1787394941.553707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5565:x1874219304485632:12345-192.168.203.16@tcp:503: Request processed in 376us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.553715:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:1.0:1787394941.556696:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394941.556773:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485760 00000100:00100000:0.0:1787394941.556782:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485760 00000100:00100000:0.0:1787394941.556886:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:0.0:1787394941.556896:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5583:x1874219304485760:12345-192.168.203.16@tcp:502: 00000100:00100000:0.0:1787394941.557214:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5583:x1874219304485760:12345-192.168.203.16@tcp:502: Request processed in 319us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394941.557222:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:0.0:1787394941.581222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.582866:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304485888 00000100:00100000:2.0:1787394941.582879:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304485888 00000100:00100000:2.0:1787394941.582927:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:2.0:1787394941.582939:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5583:x1874219304485888:12345-192.168.203.16@tcp:502: 00000100:00100000:2.0:1787394941.584629:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5583:x1874219304485888:12345-192.168.203.16@tcp:502: Request processed in 1683us (3406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.584642:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787394941.594102:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.595514:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486016 00000100:00100000:2.0:1787394941.595527:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486016 00000100:00100000:2.0:1787394941.595658:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:2.0:1787394941.595668:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5565:x1874219304486016:12345-192.168.203.16@tcp:101: 00010000:00010000:2.0:1787394941.595684:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394941.595702:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa49800/0xedbabbe2e89a7f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc20be expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.595729:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa49800/0xedbabbe2e89a7f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20be expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.595740:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa49800/0xedbabbe2e89a7f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20be expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394941.595765:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49800, rc 0) 00000100:00100000:2.0:1787394941.595832:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5565:x1874219304486016:12345-192.168.203.16@tcp:101: Request processed in 165us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.595838:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:1.0:1787394941.602300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394941.602958:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486144 00000100:00100000:0.0:1787394941.602968:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486144 00000100:00100000:0.0:1787394941.603058:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:0.0:1787394941.603070:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5565:x1874219304486144:12345-192.168.203.16@tcp:256: 20000000:01000000:0.0:1787394941.603108:0:5795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787394941.603124:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787394941.603128:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787394941.603131:0:5795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787394941.603132:0:5795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787394941.607211:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5565:x1874219304486144:12345-192.168.203.16@tcp:256: Request processed in 4132us (4909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394941.607226:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:2.0:1787394941.613889:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394941.614023:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486272 00000100:00100000:3.0:1787394941.614033:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486272 00000100:00100000:3.0:1787394941.614088:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:3.0:1787394941.614097:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5565:x1874219304486272:12345-192.168.203.16@tcp:101: 00010000:00010000:3.0:1787394941.614112:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394941.614128:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc20c5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394941.614154:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394941.614165:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394941.614174:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787394941.614226:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5565:x1874219304486272:12345-192.168.203.16@tcp:101: Request processed in 130us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394941.614233:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:0.0:1787394941.625265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394941.625384:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486400 00000100:00100000:3.0:1787394941.625395:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486400 00000100:00100000:3.0:1787394941.625441:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:3.0:1787394941.625451:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5565:x1874219304486400:12345-192.168.203.16@tcp:501: 00000100:00100000:3.0:1787394941.625740:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5565:x1874219304486400:12345-192.168.203.16@tcp:501: Request processed in 289us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394941.625748:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:0.0:1787394941.628216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394941.628297:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486528 00000100:00100000:3.0:1787394941.628321:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486528 00000100:00100000:3.0:1787394941.628374:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:3.0:1787394941.628394:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5565:x1874219304486528:12345-192.168.203.16@tcp:503: 00000100:00100000:3.0:1787394941.628723:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5565:x1874219304486528:12345-192.168.203.16@tcp:503: Request processed in 330us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394941.628732:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:1.0:1787394941.634134:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394941.634201:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486656 00000100:00100000:2.0:1787394941.634209:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486656 00000100:00100000:2.0:1787394941.634259:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:2.0:1787394941.634268:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5588:x1874219304486656:12345-192.168.203.16@tcp:502: 00000100:00100000:2.0:1787394941.634536:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5588:x1874219304486656:12345-192.168.203.16@tcp:502: Request processed in 268us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394941.634544:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:0.0:1787394941.638017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394941.638218:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486784 00000100:00100000:1.0:1787394941.638228:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486784 00000100:00100000:1.0:1787394941.638278:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:1.0:1787394941.638289:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5588:x1874219304486784:12345-192.168.203.16@tcp:502: 00000100:00100000:1.0:1787394941.638554:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5588:x1874219304486784:12345-192.168.203.16@tcp:502: Request processed in 266us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394941.638562:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:1.0:1787394941.643182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394941.643426:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304486912 00000100:00100000:3.0:1787394941.643435:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304486912 00000100:00100000:3.0:1787394941.643482:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787394941.643490:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2362:x1874219304486912:12345-192.168.203.16@tcp:38: 00010000:00080000:3.0:1787394941.643518:0:5803:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1787394941.643556:0:5803:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a7f49 00000004:00100000:3.0:1787394941.643584:0:5803:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787394941.643590:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787394941.663078:0:5803:0:(import.c:65:import_set_state_nolock()) ffffa0b318da3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787394941.663197:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304486912:12345-192.168.203.16@tcp:38: Request processed in 19704us (20033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394941.663207:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1787394942.036414:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323382656:0@lo:400: 00000100:00100000:0.0:1787394942.036482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394942.036539:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787394942.036545:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323382528:0@lo:400: 00000100:00100000:0.0:1787394942.036565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394942.036599:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382656 00000100:00100000:0.0:1787394942.036606:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382656 00000100:00100000:2.0:1787394942.036618:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382528 00000100:00100000:2.0:1787394942.036622:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382528 00000100:00100000:2.0:1787394942.036675:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787394942.036685:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323382528:12345-0@lo:400: 00000100:00100000:3.0:1787394942.036692:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323382272:0@lo:400: 00000100:00100000:3.0:1787394942.036724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394942.036752:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323382784:0@lo:400: 00000100:00100000:2.0:1787394942.036759:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323382528:12345-0@lo:400: Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.036767:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787394942.036778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394942.036790:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787394942.036798:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323382656:12345-0@lo:400: 00000100:00100000:3.0:1787394942.036813:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394942.036820:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323382400:0@lo:400: 00000100:00100000:2.0:1787394942.036833:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323382656:12345-0@lo:400: Request processed in 35us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.036841:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787394942.036847:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394942.036914:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382272 00000100:00100000:1.0:1787394942.036918:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382272 00000100:00100000:1.0:1787394942.036945:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787394942.036961:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323382272:12345-0@lo:400: 00000100:00100000:1.0:1787394942.036993:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323382272:12345-0@lo:400: Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394942.036999:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787394942.037024:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382784 00000100:00100000:1.0:1787394942.037027:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382784 00000100:00100000:1.0:1787394942.037051:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787394942.037057:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323382784:12345-0@lo:400: 00000100:00100000:1.0:1787394942.037083:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323382784:12345-0@lo:400: Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394942.037088:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787394942.037115:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787394942.037120:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394942.043830:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382400 00000100:00100000:2.0:1787394942.043861:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382400 00000100:00100000:3.0:1787394942.043929:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323382272:0@lo:400: 00010000:00080000:3.0:1787394942.043959:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bfb80 x1874219323382784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394942.043977:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787394942.043993:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323382784:0@lo:400: 00010000:00080000:3.0:1787394942.044043:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bdf80 x1874219323382528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394942.044054:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323382528:0@lo:400: 00010000:00080000:3.0:1787394942.044067:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323382656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394942.044076:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323382656:0@lo:400: 00000100:00100000:3.0:1787394942.050362:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787394942.050385:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323382400:12345-0@lo:400: 00000100:00100000:3.0:1787394942.050496:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323382400:12345-0@lo:400: Request processed in 122us (13649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394942.050504:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787394942.050711:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bd500 x1874219323382400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787394958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394942.050727:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323382400:0@lo:400: 00010000:00010000:3.0:1787394942.418516:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394942.547176:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787394942.547204:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323382912:0@lo:13: 00000100:00100000:2.0:1787394942.547271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394942.547456:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323382912 00000100:00100000:0.0:1787394942.547463:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323382912 00000100:00100000:0.0:1787394942.547505:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787394942.547513:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323382912:12345-0@lo:13: 00002000:00000024:0.0:1787394942.547543:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394942.547587:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323382912:12345-0@lo:13: Request processed in 75us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394942.547594:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787394942.547937:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367be680 x1874219323382912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394942.547963:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323382912:0@lo:13: 00000100:00100000:3.0:1787394942.685987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394942.686038:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394942.688265:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487168 00000100:00100000:2.0:1787394942.688278:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487168 00000100:00100000:2.0:1787394942.688412:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487040 00000100:00100000:2.0:1787394942.688415:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487040 00000100:00100000:2.0:1787394942.688435:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787394942.688527:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:5565:x1874219304487168:12345-192.168.203.16@tcp:41: 00000004:00000024:2.0:1787394942.688573:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787394942.688646:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:5565:x1874219304487168:12345-192.168.203.16@tcp:41: Request processed in 202us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.688654:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787394942.688672:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787394942.688679:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:0:x1874219304487040:12345-192.168.203.16@tcp:41: 00000004:00000024:2.0:1787394942.688689:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787394942.688711:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:0:x1874219304487040:12345-192.168.203.16@tcp:41: Request processed in 33us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.688716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787394942.691081:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00080000:1.0:1787394942.692855:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394942.694856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487296 00000100:00100000:2.0:1787394942.694871:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487296 00000100:00100000:2.0:1787394942.694995:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787394942.695007:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:5565:x1874219304487296:12345-192.168.203.16@tcp:40: 00000100:00100000:2.0:1787394942.695130:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:5565:x1874219304487296:12345-192.168.203.16@tcp:40: Request processed in 125us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.695138:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787394942.700862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394942.701020:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487424 00000100:00100000:1.0:1787394942.701031:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487424 00000100:00100000:1.0:1787394942.701084:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1787394942.701092:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1874219304487424:12345-192.168.203.16@tcp:8: 00010000:00080000:1.0:1787394942.701122:0:6601:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1787394942.701150:0:6601:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a7f50 00002000:00100000:1.0:1787394942.701175:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cada4208-c1d6-4319-a546-8bfc38316f45/ffffa0b33fa8b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787394942.701186:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787394942.701562:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787394942.702638:0:6601:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787394942.702735:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304487424:12345-192.168.203.16@tcp:8: Request processed in 1639us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394942.702746:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:3.0:1787394942.706443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394942.707860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394942.708683:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394942.709677:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487808 00000100:00100000:2.0:1787394942.709689:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487808 00000100:00100000:2.0:1787394942.709757:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:2.0:1787394942.709767:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2364:x1874219304487808:12345-192.168.203.16@tcp:400: 00000100:00100000:2.0:1787394942.709859:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2364:x1874219304487808:12345-192.168.203.16@tcp:400: Request processed in 82us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394942.709868:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:0.0:1787394942.710181:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487680 00000100:00100000:0.0:1787394942.710187:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487680 00000100:00100000:0.0:1787394942.710226:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1787394942.710234:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:5565:x1874219304487680:12345-192.168.203.16@tcp:33: 00000100:00100000:1.0:1787394942.719195:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487552 00000100:00100000:1.0:1787394942.719211:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487552 00000100:00100000:1.0:1787394942.719264:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:1.0:1787394942.719274:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874219304487552:12345-192.168.203.16@tcp:8: 00010000:00080000:1.0:1787394942.719319:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:1.0:1787394942.719352:0:6599:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a7f57 00002000:00100000:1.0:1787394942.719364:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cada4208-c1d6-4319-a546-8bfc38316f45/ffffa0b327f7e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787394942.719375:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787394942.720175:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787394942.720217:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b3108b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787394942.724350:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304487552:12345-192.168.203.16@tcp:8: Request processed in 5062us (17903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394942.724366:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000004:00080000:0.0:1787394942.740342:0:5805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30035us 00000004:00200000:3.0:1787394942.752062:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787394942.752302:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:5565:x1874219304487680:12345-192.168.203.16@tcp:33: Request processed in 42058us (44448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394942.752343:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1787394942.958912:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394942.959112:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304487936 00000100:00100000:1.0:1787394942.959121:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304487936 00000100:00100000:1.0:1787394942.959190:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1787394942.959202:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:5606:x1874219304487936:12345-192.168.203.16@tcp:101: 00010000:00010000:1.0:1787394942.959221:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394942.959262:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166c00/0xedbabbe2e89a7f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc20ef expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959371:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959386:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959401:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787394942.959609:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787394942.959613:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787394942.959692:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959718:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166c00/0xedbabbe2e89a7f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20ef expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959735:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20ef expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394942.959742:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787394942.959745:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787394942.959748:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166600, rc 0) 00000100:00100000:1.0:1787394942.959812:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:5606:x1874219304487936:12345-192.168.203.16@tcp:101: Request processed in 612us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394942.959820:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00010000:00010000:3.0:1787394943.443947:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394944.466463:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394944.922735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394944.922913:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488064 00000100:00100000:3.0:1787394944.922933:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488064 00000100:00100000:3.0:1787394944.923018:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:3.0:1787394944.923032:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:5658:x1874219304488064:12345-192.168.203.16@tcp:41: 00000004:00000024:3.0:1787394944.923075:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787394944.923143:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:5658:x1874219304488064:12345-192.168.203.16@tcp:41: Request processed in 115us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394944.923150:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00080000:1.0:1787394944.923914:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394944.929420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394944.929513:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488192 00000100:00100000:0.0:1787394944.929522:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488192 00000100:00100000:0.0:1787394944.929589:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787394944.929599:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cada4208-c1d6-4319-a546-8bfc38316f45+6:5658:x1874219304488192:12345-192.168.203.16@tcp:13: 00002000:00000024:0.0:1787394944.929633:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394944.929702:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cada4208-c1d6-4319-a546-8bfc38316f45+6:5658:x1874219304488192:12345-192.168.203.16@tcp:13: Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394944.929724:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00080000:1.0:1787394944.931092:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787394944.934207:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394944.934300:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488320 00000100:00100000:2.0:1787394944.934337:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488320 00000100:00100000:2.0:1787394944.934404:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787394944.934415:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cada4208-c1d6-4319-a546-8bfc38316f45+6:5658:x1874219304488320:12345-192.168.203.16@tcp:13: 00002000:00000024:2.0:1787394944.934450:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394944.934519:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:cada4208-c1d6-4319-a546-8bfc38316f45+6:5658:x1874219304488320:12345-192.168.203.16@tcp:13: Request processed in 105us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394944.934526:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00080000:1.0:1787394944.934633:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787394945.490513:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394946.514455:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394946.642532:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323383040:0@lo:13: 00000100:00100000:2.0:1787394946.642593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394946.642661:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383040 00000100:00100000:2.0:1787394946.642668:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383040 00000100:00100000:2.0:1787394946.642715:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787394946.642735:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323383040:12345-0@lo:13: 00002000:00000024:2.0:1787394946.642771:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394946.642811:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323383040:12345-0@lo:13: Request processed in 78us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394946.642817:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787394946.642835:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787394946.642859:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b3b80 x1874219323383040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394946.643073:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323383040:0@lo:13: 00000001:00100000:1.0:1787394946.719716:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000100:00100000:0.0:1787394947.154567:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323383296:0@lo:400: 00000100:00100000:0.0:1787394947.154636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394947.154683:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323383808:0@lo:400: 00000100:00100000:0.0:1787394947.154721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394947.154752:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787394947.154758:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323383424:0@lo:400: 00000100:00100000:0.0:1787394947.154779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394947.154825:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383296 00000100:00100000:0.0:1787394947.154831:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383296 00000100:00100000:0.0:1787394947.154870:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383424 00000100:00100000:0.0:1787394947.154873:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383424 00000100:00100000:0.0:1787394947.154896:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787394947.154903:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323383296:12345-0@lo:400: 00000100:00100000:0.0:1787394947.154961:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323383296:12345-0@lo:400: Request processed in 58us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.154977:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787394947.154993:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787394947.154999:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323383424:12345-0@lo:400: 00000100:00100000:0.0:1787394947.155029:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323383424:12345-0@lo:400: Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.155034:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787394947.155053:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383808 00000100:00100000:0.0:1787394947.155057:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383808 00000100:00100000:0.0:1787394947.155081:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787394947.155087:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323383808:12345-0@lo:400: 00000100:00100000:0.0:1787394947.155115:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323383808:12345-0@lo:400: Request processed in 28us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.155121:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787394947.155229:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323383424:0@lo:400: 00000100:00100000:0.0:1787394947.155241:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323383296:0@lo:400: 00010000:00080000:0.0:1787394947.155253:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bfb80 x1874219323383808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394947.155263:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323383808:0@lo:400: 00000100:00100000:1.0:1787394947.155484:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323383168:0@lo:400: 00000100:00100000:1.0:1787394947.155516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394947.155543:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323383680:0@lo:400: 00000100:00100000:1.0:1787394947.155563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394947.155582:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787394947.155588:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323383552:0@lo:400: 00000100:00100000:1.0:1787394947.155611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394947.155636:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383168 00000100:00100000:1.0:1787394947.155640:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383168 00000100:00100000:1.0:1787394947.155666:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787394947.155672:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323383168:12345-0@lo:400: 00000100:00100000:1.0:1787394947.155716:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323383168:12345-0@lo:400: Request processed in 43us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394947.155722:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787394947.155749:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383552 00000100:00100000:1.0:1787394947.155752:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383552 00000100:00100000:1.0:1787394947.155771:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787394947.155776:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323383552:12345-0@lo:400: 00000100:00100000:1.0:1787394947.155800:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323383552:12345-0@lo:400: Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394947.155816:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787394947.155839:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323383552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394947.155849:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323383552:0@lo:400: 00000100:00100000:1.0:1787394947.155857:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323383168:0@lo:400: 00000100:00100000:1.0:1787394947.155879:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383680 00000100:00100000:1.0:1787394947.155882:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383680 00000100:00100000:1.0:1787394947.155902:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787394947.155907:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323383680:12345-0@lo:400: 00000100:00100000:1.0:1787394947.155947:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323383680:12345-0@lo:400: Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394947.155953:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787394947.155974:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323383680:0@lo:400: 00000100:00080000:2.0:1787394947.156861:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787394947.156868:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787394947.225239:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000001:00100000:3.0:1787394947.227082:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000001:02000400:1.0:1787394947.326288:0:8156:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787394947.540987:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394947.666580:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323383936:0@lo:13: 00000100:00100000:1.0:1787394947.666647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394947.666946:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323383936 00000100:00100000:3.0:1787394947.666955:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323383936 00000100:00100000:3.0:1787394947.667021:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787394947.667030:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323383936:12345-0@lo:13: 00002000:00000024:3.0:1787394947.667064:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787394947.667135:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323383936:12345-0@lo:13: Request processed in 104us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394947.667142:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1787394947.667218:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291a2680 x1874219323383936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394947.667236:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323383936:0@lo:13: 00000100:00100000:0.0:1787394947.983538:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394947.983575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394947.983605:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394947.983631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394947.983658:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488448 00000100:00100000:0.0:1787394947.983672:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488448 00000100:00100000:0.0:1787394947.983715:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:0.0:1787394947.983724:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2365:x1874219304488448:12345-192.168.203.16@tcp:400: 00000100:00100000:0.0:1787394947.983783:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2365:x1874219304488448:12345-192.168.203.16@tcp:400: Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.983791:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:0.0:1787394947.983818:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488832 00000100:00100000:0.0:1787394947.983821:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488832 00000100:00100000:0.0:1787394947.983848:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488704 00000100:00100000:0.0:1787394947.983850:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488704 00000100:00100000:0.0:1787394947.983863:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787394947.983869:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304488832:12345-192.168.203.16@tcp:400: 00000100:00100000:0.0:1787394947.983895:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304488832:12345-192.168.203.16@tcp:400: Request processed in 26us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.983902:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787394947.983924:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787394947.983931:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304488704:12345-192.168.203.16@tcp:400: 00000100:00100000:0.0:1787394947.983950:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304488704:12345-192.168.203.16@tcp:400: Request processed in 20us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394947.983956:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00080000:0.0:1787394947.984090:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787394947.984094:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787394947.987629:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488576 00000100:00100000:1.0:1787394947.987643:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488576 00000100:00100000:1.0:1787394947.987714:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:1.0:1787394947.987723:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304488576:12345-192.168.203.16@tcp:400: 00000100:00100000:1.0:1787394947.987788:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304488576:12345-192.168.203.16@tcp:400: Request processed in 66us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394947.987795:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00080000:2.0:1787394947.987987:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787394948.562476:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394949.586481:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394950.610494:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787394950.655605:0:8304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc8f487760 00000020:00000080:3.0:1787394950.655621:0:8304:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787394950.655633:0:8304:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787394950.655642:0:8304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8f4899f0 20000000:00000080:3.0:1787394950.655649:0:8304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b336317400 uarg=0000000000000000 20000000:01000000:3.0:1787394950.655685:0:8304:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787394950.655688:0:8304:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787394950.655690:0:8304:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787394950.655695:0:8304:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787394950.655700:0:8304:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787394950.655713:0:8304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787394950.655715:0:8304:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787394950.655933:0:8304:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787394950.655935:0:8304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787394950.657005:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787394950.657711:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787394950.657783:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787394950.657822:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787394950.657834:0:8304:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787394950.657836:0:8304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787394950.658765:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787394950.659519:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787394950.659566:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787394950.659696:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787394950.659711:0:8304:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787394950.659713:0:8304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787394950.660959:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787394950.661545:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787394950.661684:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787394950.661724:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787394950.661735:0:8304:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787394950.661738:0:8304:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787394950.662696:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787394950.663063:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787394950.663105:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787394950.663156:0:8304:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787394950.663172:0:8304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787394950.663191:0:8304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663219:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663227:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663234:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663242:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663249:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663256:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663262:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663271:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663278:0:8304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663285:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663407:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663423:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663438:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384064:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787394950.663572:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663581:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 9 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663590:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384192:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787394950.663621:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663629:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 18 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663638:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384320:0@lo:104: 00000100:00100000:3.0:1787394950.663686:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394950.663730:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663739:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 18 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663759:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384448:0@lo:104: 00000100:00100000:3.0:1787394950.663786:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394950.663822:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663830:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663838:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384576:0@lo:104: 00010000:00010000:3.0:1787394950.663863:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663870:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 18 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663878:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384704:0@lo:104: 00010000:00010000:3.0:1787394950.663914:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663922:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663930:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384832:0@lo:104: 00010000:00010000:3.0:1787394950.663952:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.663958:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.663978:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384960:0@lo:104: 00010000:00010000:3.0:1787394950.664003:0:8304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394950.664011:0:8304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 18 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.664019:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323385088:0@lo:104: 00000100:00100000:3.0:1787394950.664035:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffecd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787394950.664351:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787394950.664371:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.664385:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.664393:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.664412:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.664429:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.664440:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384320 00000100:00100000:1.0:1787394950.664445:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384320 00000100:00100000:1.0:1787394950.664483:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384448 00000100:00100000:1.0:1787394950.664486:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384448 00000100:00100000:1.0:1787394950.664495:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384576 00000100:00100000:1.0:1787394950.664497:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384576 00000100:00100000:1.0:1787394950.664506:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384704 00000100:00100000:1.0:1787394950.664507:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384704 00000100:00100000:1.0:1787394950.664517:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384832 00000100:00100000:1.0:1787394950.664519:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384832 00000100:00100000:1.0:1787394950.664528:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323384960 00000100:00100000:1.0:1787394950.664530:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323384960 00000100:00100000:1.0:1787394950.664538:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385088 00000100:00100000:1.0:1787394950.664540:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385088 00000100:00100000:1.0:1787394950.664566:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394950.664574:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:8304:x1874219323384320:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664598:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.664654:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787394950.664660:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+9:8304:x1874219323384320:12345-0@lo:104: Request processed in 87us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.664666:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394950.664683:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394950.664689:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f428c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+8:8304:x1874219323384448:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664696:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.664726:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787394950.664731:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f428c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+8:8304:x1874219323384448:12345-0@lo:104: Request processed in 43us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.664744:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394950.664771:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394950.664777:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:8304:x1874219323384576:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664783:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.664829:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787394950.664833:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+7:8304:x1874219323384576:12345-0@lo:104: Request processed in 57us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.664839:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394950.664851:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787394950.664856:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:8304:x1874219323384704:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664863:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.664897:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787394950.664902:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+6:8304:x1874219323384704:12345-0@lo:104: Request processed in 47us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.664908:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787394950.664920:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787394950.664926:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:8304:x1874219323384832:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664932:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.664954:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787394950.664958:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:8304:x1874219323384832:12345-0@lo:104: Request processed in 34us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.664968:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787394950.664983:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787394950.664988:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:8304:x1874219323384960:12345-0@lo:104: 00010000:00010000:1.0:1787394950.664995:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665020:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787394950.665024:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:8304:x1874219323384960:12345-0@lo:104: Request processed in 37us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.665029:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787394950.665040:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787394950.665046:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:8304:x1874219323385088:12345-0@lo:104: 00010000:00010000:1.0:1787394950.665053:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665077:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787394950.665081:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:8304:x1874219323385088:12345-0@lo:104: Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.665087:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787394950.665103:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787394950.665109:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665194:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665202:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665222:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665228:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665234:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665269:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665276:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665293:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665300:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342167600/0xedbabbe2e89a7f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7f18 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665339:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787394950.665342:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665348:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665351:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665357:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665363:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665374:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665388:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665392:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665397:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665403:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300030600/0xedbabbe2e89a7eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ef5 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665411:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787394950.665414:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665418:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665421:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665427:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665432:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665436:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665446:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665451:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665471:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665477:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031000/0xedbabbe2e89a7ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ed9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665485:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787394950.665488:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665493:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665496:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665502:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665508:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665512:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665525:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665529:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665534:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665540:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a7ec4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ecb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665547:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787394950.665555:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665560:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665563:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665568:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665573:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665578:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665589:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665595:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665601:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665607:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300030e00/0xedbabbe2e89a7eb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ebd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665617:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787394950.665620:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665626:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148e800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665630:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665650:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665657:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665661:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665672:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665677:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665681:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665687:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148e800/0xedbabbe2e89a7e8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e93 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665695:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787394950.665697:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665701:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148f000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394950.665704:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665709:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394950.665714:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394950.665724:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787394950.665737:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665743:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394950.665747:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665753:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148f000/0xedbabbe2e89a7e62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e69 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.665768:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394950.665770:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394950.665772:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394950.665780:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394950.665785:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394950.665805:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385216:0@lo:103: 00000100:00100000:1.0:1787394950.665840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.665869:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385728:0@lo:103: 00000100:00100000:1.0:1787394950.665902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.665921:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787394950.665927:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385344:0@lo:103: 00000100:00100000:1.0:1787394950.665945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.665960:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385856:0@lo:103: 00000100:00100000:1.0:1787394950.665976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.665995:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385472:0@lo:103: 00000100:00100000:1.0:1787394950.666014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.666032:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385984:0@lo:103: 00000100:00100000:1.0:1787394950.666049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.666058:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787394950.666062:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385600:0@lo:103: 00000100:00100000:1.0:1787394950.666079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394950.666099:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385216 00000100:00100000:1.0:1787394950.666104:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385216 00010000:00010000:1.0:1787394950.666578:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 19 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666609:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385728 00000100:00100000:1.0:1787394950.666613:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385728 00010000:00010000:1.0:1787394950.666627:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 20 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666637:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385344 00000100:00100000:1.0:1787394950.666639:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385344 00010000:00010000:1.0:1787394950.666649:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 21 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666658:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385856 00000100:00100000:1.0:1787394950.666660:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385856 00010000:00010000:1.0:1787394950.666670:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 22 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666679:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385472 00000100:00100000:1.0:1787394950.666681:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385472 00010000:00010000:1.0:1787394950.666690:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 23 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666699:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385984 00000100:00100000:1.0:1787394950.666701:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385984 00010000:00010000:1.0:1787394950.666723:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 24 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666735:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323385600 00000100:00100000:1.0:1787394950.666738:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323385600 00010000:00010000:1.0:1787394950.666748:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 25 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394950.666760:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394950.666767:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+25:3303:x1874219323385216:12345-0@lo:103: 00010000:00010000:1.0:1787394950.666778:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.666783:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 25 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666792:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 25 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666809:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.666847:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+25:3303:x1874219323385216:12345-0@lo:103: Request processed in 81us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.666853:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787394950.666867:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394950.666873:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+24:3303:x1874219323385728:12345-0@lo:103: 00010000:00010000:1.0:1787394950.666879:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.666883:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 24 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666902:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 24 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666923:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.666946:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+24:3303:x1874219323385728:12345-0@lo:103: Request processed in 73us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.666951:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394950.666963:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394950.666969:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+23:3303:x1874219323385344:12345-0@lo:103: 00010000:00010000:1.0:1787394950.666976:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.666980:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 23 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666988:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 23 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.666996:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.667016:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+23:3303:x1874219323385344:12345-0@lo:103: Request processed in 48us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.667023:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787394950.667037:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787394950.667044:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+22:3303:x1874219323385856:12345-0@lo:103: 00010000:00010000:1.0:1787394950.667052:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.667057:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 22 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667066:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 22 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667075:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.667103:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+22:3303:x1874219323385856:12345-0@lo:103: Request processed in 60us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.667109:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787394950.667134:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787394950.667141:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+21:3305:x1874219323385472:12345-0@lo:103: 00010000:00010000:1.0:1787394950.667148:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.667152:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 21 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667160:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 21 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667170:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.667208:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+21:3305:x1874219323385472:12345-0@lo:103: Request processed in 67us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.667214:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787394950.667225:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787394950.667230:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3305:x1874219323385984:12345-0@lo:103: 00010000:00010000:1.0:1787394950.667237:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.667240:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 20 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667249:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 20 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667259:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.667279:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3305:x1874219323385984:12345-0@lo:103: Request processed in 49us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.667285:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787394950.667300:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787394950.667324:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323385600:12345-0@lo:103: 00010000:00010000:1.0:1787394950.667330:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394950.667335:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 19 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667343:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 19 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394950.667357:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394950.667382:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323385600:12345-0@lo:103: Request processed in 75us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394950.667388:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787394950.667444:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385344:0@lo:103: 00000100:00100000:1.0:1787394950.667453:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385856:0@lo:103: 00000100:00100000:1.0:1787394950.667462:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385216:0@lo:103: 00010000:00010000:3.0:1787394950.667485:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a7f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7f11 expref: 18 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.667502:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384320:0@lo:104: 00000100:00100000:1.0:1787394950.667859:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323385728:0@lo:103: 00000100:00100000:1.0:1787394950.667926:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385600:0@lo:103: 00000100:00100000:1.0:1787394950.667933:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385472:0@lo:103: 00000100:00100000:1.0:1787394950.667940:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323385984:0@lo:103: 00010000:00010000:3.0:1787394950.668008:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030800/0xedbabbe2e89a7ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7eee expref: 17 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668021:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384448:0@lo:104: 00010000:00010000:3.0:1787394950.668033:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167e00/0xedbabbe2e89a7ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7ed2 expref: 16 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668108:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384576:0@lo:104: 00010000:00010000:3.0:1787394950.668187:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300031a00/0xedbabbe2e89a7ecb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7ec4 expref: 15 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668197:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384704:0@lo:104: 00010000:00010000:3.0:1787394950.668207:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7ebd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7eb6 expref: 14 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668227:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384832:0@lo:104: 00010000:00010000:3.0:1787394950.668239:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b30148f800/0xedbabbe2e89a7e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7e8c expref: 13 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668248:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384960:0@lo:104: 00010000:00010000:3.0:1787394950.668258:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7e69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7e62 expref: 12 pid: 5796 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.668265:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323385088:0@lo:104: 00000100:00100000:0.0:1787394950.676235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394950.676277:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394950.676439:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489088 00000100:00100000:2.0:1787394950.676449:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489088 00010000:00010000:2.0:1787394950.676488:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 10 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394950.676520:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304488960 00000100:00100000:2.0:1787394950.676524:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304488960 00010000:00010000:2.0:1787394950.676537:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 11 pid: 5795 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394950.676554:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:2.0:1787394950.676563:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2363:x1874219304489088:12345-192.168.203.16@tcp:103: 00010000:00010000:2.0:1787394950.676578:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394950.676585:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 11 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.676591:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384064:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787394950.676602:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 11 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394950.676615:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8304:1874219323384192:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787394950.676654:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a7f2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc208d expref: 11 pid: 5796 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676671:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787394950.676687:0:8304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394950.676733:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304489088:12345-192.168.203.16@tcp:103: Request processed in 169us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394950.676744:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:2.0:1787394950.676770:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:2.0:1787394950.676778:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:2363:x1874219304488960:12345-192.168.203.16@tcp:103: 00010000:00010000:2.0:1787394950.676788:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787394950.676794:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676806:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676819:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48a00/0xedbabbe2e89a7f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2094 expref: 9 pid: 5795 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676830:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676838:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676853:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676859:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676872:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676878:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676884:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787394950.676898:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676906:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676924:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.676935:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787394950.676955:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:2363:x1874219304488960:12345-192.168.203.16@tcp:103: Request processed in 178us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394950.676962:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00010000:00010000:2.0:1787394950.677406:0:8304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.677417:0:8304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394950.677423:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a7f6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.634699:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394951.762626:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787394951.762655:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323386112:0@lo:13: 00000100:00100000:0.0:1787394951.762724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394951.762915:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386112 00000100:00100000:2.0:1787394951.762936:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386112 00000100:00100000:2.0:1787394951.763002:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787394951.763013:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323386112:12345-0@lo:13: 00002000:00000024:2.0:1787394951.763050:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394951.763111:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323386112:12345-0@lo:13: Request processed in 99us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394951.763118:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787394951.763144:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787394951.763179:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b3b80 x1874219323386112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394951.763201:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323386112:0@lo:13: 10000000:01000000:1.0:1787394951.954642:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787394951.954651:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b33f645800 from 39 10000000:01000000:1.0:1787394951.954657:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787394951.954707:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.954732:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.954743:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.954766:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386240:0@lo:101: 00000100:00100000:1.0:1787394951.954833:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.954910:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787394951.955655:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386240 00000100:00100000:2.0:1787394951.955673:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386240 00000100:00100000:2.0:1787394951.955730:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787394951.955739:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+12:5799:x1874219323386240:12345-0@lo:101: 00010000:00010000:2.0:1787394951.955753:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394951.955770:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48800/0xedbabbe2e89a7f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7f73 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.955796:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48800/0xedbabbe2e89a7f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f73 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.955807:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48800/0xedbabbe2e89a7f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f73 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.955816:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48800, rc 0) 00000100:00100000:2.0:1787394951.955873:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386240:12345-0@lo:101: Request processed in 134us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394951.955902:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787394951.956109:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386240:0@lo:101: 00010000:00010000:1.0:1787394951.956126:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.956136:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.956193:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386368:0@lo:501: 00000100:00100000:1.0:1787394951.956224:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.956256:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.956300:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386368 00000100:00100000:0.0:1787394951.956328:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386368 00000100:00100000:0.0:1787394951.956365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787394951.956372:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386368:12345-0@lo:501: 00000100:00100000:0.0:1787394951.956621:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386368:12345-0@lo:501: Request processed in 249us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.956629:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787394951.956749:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386368:0@lo:501: 00000100:00100000:1.0:1787394951.956775:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386496:0@lo:503: 00000100:00100000:1.0:1787394951.956809:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.956836:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.956904:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386496 00000100:00100000:0.0:1787394951.956908:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386496 00000100:00100000:0.0:1787394951.956939:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787394951.956946:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386496:12345-0@lo:503: 00000100:00100000:0.0:1787394951.957089:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386496:12345-0@lo:503: Request processed in 143us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.957096:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787394951.957623:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386496:0@lo:503: 00000100:00100000:2.0:1787394951.958051:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8320:1874219323386624:0@lo:502: 00000100:00100000:2.0:1787394951.958093:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394951.958129:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.958180:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386624 00000100:00100000:3.0:1787394951.958185:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386624 00000100:00100000:3.0:1787394951.958229:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787394951.958238:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:8320:x1874219323386624:12345-0@lo:502: 00000100:00100000:3.0:1787394951.958474:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:8320:x1874219323386624:12345-0@lo:502: Request processed in 235us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.958481:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787394951.958674:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8320:1874219323386624:0@lo:502: 00000100:00100000:2.0:1787394951.958712:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8320:1874219323386752:0@lo:502: 00000100:00100000:2.0:1787394951.958742:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394951.958768:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.958868:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386752 00000100:00100000:1.0:1787394951.958873:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386752 00000100:00100000:1.0:1787394951.958912:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787394951.958926:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:8320:x1874219323386752:12345-0@lo:502: 00000100:00100000:1.0:1787394951.959068:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:8320:x1874219323386752:12345-0@lo:502: Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.959074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787394951.959186:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8320:1874219323386752:0@lo:502: 00000040:00080000:2.0:1787394951.959216:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787394951.959454:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787394951.959473:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787394951.959482:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.959494:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394951.959504:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787394951.959513:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787394951.959516:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787394951.959542:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.959551:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.959560:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394951.959573:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386880:0@lo:101: 00000100:00100000:0.0:1787394951.959602:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.959631:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787394951.959761:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323386880 00000100:00100000:2.0:1787394951.959766:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323386880 00000100:00100000:2.0:1787394951.959799:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787394951.959807:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+13:5799:x1874219323386880:12345-0@lo:101: 00010000:00010000:2.0:1787394951.959817:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394951.959828:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48e00/0xedbabbe2e89a7f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7f81 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.959848:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48e00/0xedbabbe2e89a7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f81 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.959859:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48e00/0xedbabbe2e89a7f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f81 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394951.959868:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48e00, rc 0) 00000100:00100000:2.0:1787394951.959926:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323386880:12345-0@lo:101: Request processed in 120us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394951.959934:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787394951.960040:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323386880:0@lo:101: 00010000:00010000:1.0:1787394951.960052:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.960061:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.960104:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387008:0@lo:501: 00000100:00100000:1.0:1787394951.960129:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.960148:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192480 going to sleep for 11 seconds 00000100:00100000:2.0:1787394951.960188:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387008 00000100:00100000:2.0:1787394951.960192:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387008 00000100:00100000:2.0:1787394951.960347:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787394951.960354:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323387008:12345-0@lo:501: 00000100:00100000:2.0:1787394951.960579:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323387008:12345-0@lo:501: Request processed in 225us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394951.960587:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787394951.960651:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387008:0@lo:501: 00000100:00100000:1.0:1787394951.960687:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387136:0@lo:503: 00000100:00100000:1.0:1787394951.960721:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.962521:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192480 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.962603:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387136 00000100:00100000:0.0:1787394951.962611:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387136 00000100:00100000:0.0:1787394951.962655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787394951.962744:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323387136:12345-0@lo:503: 00000100:00100000:0.0:1787394951.963032:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323387136:12345-0@lo:503: Request processed in 369us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.963039:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787394951.963191:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387136:0@lo:503: 00000100:00100000:3.0:1787394951.968943:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8321:1874219323387264:0@lo:502: 00000100:00100000:3.0:1787394951.969031:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.969079:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.970533:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387264 00000100:00100000:1.0:1787394951.970544:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387264 00000100:00100000:1.0:1787394951.970608:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787394951.970618:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:8321:x1874219323387264:12345-0@lo:502: 00000100:00100000:1.0:1787394951.970966:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:8321:x1874219323387264:12345-0@lo:502: Request processed in 348us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.970974:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787394951.971100:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8321:1874219323387264:0@lo:502: 00000020:01000000:3.0:1787394951.971149:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787394951.971158:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394951.971160:0:8321:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787394951.971167:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787394951.971197:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8321:1874219323387392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.971247:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.971288:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.971421:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387392 00000100:00100000:0.0:1787394951.971426:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387392 00000100:00100000:0.0:1787394951.971463:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787394951.971472:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:8321:x1874219323387392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.971598:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:8321:x1874219323387392:12345-0@lo:502:llog_process_th.0 Request processed in 126us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.971605:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787394951.972818:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8321:1874219323387392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787394951.972854:0:8321:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787394951.972861:0:8321:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394951.972864:0:8321:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787394951.972869:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787394951.973337:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787394951.973354:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787394951.973364:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.973375:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394951.973385:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787394951.973388:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b305de9800 from 39 10000000:01000000:1.0:1787394951.973391:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787394951.973420:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.973428:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.973438:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.973457:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787394951.973506:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.973535:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192900 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.973660:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387520 00000100:00100000:0.0:1787394951.973819:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387520 00000100:00100000:0.0:1787394951.973863:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787394951.973872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:5799:x1874219323387520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787394951.973893:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394951.973905:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341011800/0xedbabbe2e89a7f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7f8f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.973926:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341011800/0xedbabbe2e89a7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f8f expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.973936:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341011800/0xedbabbe2e89a7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f8f expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.973945:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011800, rc 0) 00000100:00100000:0.0:1787394951.973989:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323387520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.973996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787394951.974096:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787394951.974109:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.974128:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394951.974175:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.974201:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.974235:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.975530:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387648 00000100:00100000:0.0:1787394951.975540:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387648 00000100:00100000:0.0:1787394951.975584:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787394951.975592:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323387648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.975969:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323387648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 376us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.975976:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787394951.976165:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.976219:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.976263:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.976286:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.976970:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387776 00000100:00100000:0.0:1787394951.976977:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387776 00000100:00100000:0.0:1787394951.977019:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787394951.977027:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323387776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.977505:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323387776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 477us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.977514:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787394951.981815:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323387776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.988241:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8322:1874219323387904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.988361:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.988402:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.988478:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323387904 00000100:00100000:3.0:1787394951.988485:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323387904 00000100:00100000:3.0:1787394951.988529:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787394951.988537:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:8322:x1874219323387904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.988773:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:8322:x1874219323387904:12345-0@lo:502:llog_process_th.0 Request processed in 236us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.988781:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787394951.988975:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8322:1874219323387904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.989019:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8322:1874219323388032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.989050:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.989077:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.989121:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388032 00000100:00100000:3.0:1787394951.989125:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388032 00000100:00100000:3.0:1787394951.989156:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787394951.989163:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:8322:x1874219323388032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.989335:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:8322:x1874219323388032:12345-0@lo:502:llog_process_th.0 Request processed in 171us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.989341:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787394951.989415:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8322:1874219323388032:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787394951.989437:0:8322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787394951.989680:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787394951.989698:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787394951.989707:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.989718:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787394951.989727:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787394951.989730:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787394951.989732:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787394951.989757:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.989773:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.989781:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394951.989795:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.989823:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.989855:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec000 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.989901:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388160 00000100:00100000:1.0:1787394951.989905:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388160 00000100:00100000:1.0:1787394951.989936:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787394951.989942:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:5799:x1874219323388160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394951.989959:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394951.989971:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167600/0xedbabbe2e89a7fa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7f9d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.989989:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167600/0xedbabbe2e89a7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f9d expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.989999:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167600/0xedbabbe2e89a7fa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7f9d expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.990007:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167600, rc 0) 00000100:00100000:1.0:1787394951.990045:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.990051:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787394951.990118:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787394951.990130:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.990139:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394951.990178:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.990212:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.990229:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.990347:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388288 00000100:00100000:1.0:1787394951.990352:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388288 00000100:00100000:1.0:1787394951.990371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787394951.990378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394951.990589:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.990596:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787394951.990838:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.990868:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.990915:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.990945:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.992520:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388416 00000100:00100000:3.0:1787394951.992533:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388416 00000100:00100000:3.0:1787394951.992584:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787394951.992594:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.992794:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.992803:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787394951.994386:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.994799:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8323:1874219323388544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.994862:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.994913:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec300 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.994957:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388544 00000100:00100000:1.0:1787394951.994963:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388544 00000100:00100000:1.0:1787394951.995008:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787394951.995017:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:8323:x1874219323388544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787394951.995220:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:8323:x1874219323388544:12345-0@lo:502:llog_process_th.0 Request processed in 203us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.995237:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787394951.995464:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8323:1874219323388544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787394951.995491:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787394951.995500:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394951.995503:0:8323:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787394951.995510:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787394951.995529:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8323:1874219323388672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.995564:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.995588:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec300 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.995635:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388672 00000100:00100000:0.0:1787394951.995640:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388672 00000100:00100000:0.0:1787394951.995667:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787394951.995675:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:8323:x1874219323388672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.995816:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:8323:x1874219323388672:12345-0@lo:502:llog_process_th.0 Request processed in 141us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.995823:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787394951.995943:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8323:1874219323388672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787394951.995963:0:8323:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787394951.995967:0:8323:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394951.995969:0:8323:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787394951.995973:0:8323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787394951.996112:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787394951.996131:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787394951.996142:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.996152:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394951.996162:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787394951.996165:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b318a89000 from 39 10000000:01000000:1.0:1787394951.996167:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787394951.996191:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.996200:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.996221:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.996237:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787394951.996268:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.996292:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192780 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.996429:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388800 00000100:00100000:3.0:1787394951.996434:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388800 00000100:00100000:3.0:1787394951.996470:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787394951.996478:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323388800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787394951.996487:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394951.996500:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7fab expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.996522:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fab expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.996532:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fab expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394951.996541:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c800, rc 0) 00000100:00100000:3.0:1787394951.996581:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323388800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.996587:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787394951.996696:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394951.996708:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394951.996728:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394951.996770:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394951.996798:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394951.996829:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192780 going to sleep for 11 seconds 00000100:00100000:3.0:1787394951.996872:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323388928 00000100:00100000:3.0:1787394951.996876:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323388928 00000100:00100000:3.0:1787394951.996918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787394951.996925:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323388928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.997159:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323388928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394951.997172:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787394951.997252:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323388928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.997281:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394951.997349:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394951.997370:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.997498:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389056 00000100:00100000:1.0:1787394951.997503:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389056 00000100:00100000:1.0:1787394951.997527:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787394951.997535:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323389056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787394951.997665:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323389056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.997673:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787394951.997755:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394951.998742:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8324:1874219323389184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.998796:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.998829:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffece40 going to sleep for 11 seconds 00000100:00100000:1.0:1787394951.998897:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389184 00000100:00100000:1.0:1787394951.998903:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389184 00000100:00100000:1.0:1787394951.998941:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787394951.998949:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8324:x1874219323389184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787394951.999161:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8324:x1874219323389184:12345-0@lo:502:llog_process_th.0 Request processed in 212us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394951.999168:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787394951.999332:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8324:1874219323389184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.999377:0:8324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8324:1874219323389312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394951.999410:0:8324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394951.999431:0:8324:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffece40 going to sleep for 11 seconds 00000100:00100000:0.0:1787394951.999487:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389312 00000100:00100000:0.0:1787394951.999492:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389312 00000100:00100000:0.0:1787394951.999526:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787394951.999534:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8324:x1874219323389312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394951.999673:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8324:x1874219323389312:12345-0@lo:502:llog_process_th.0 Request processed in 139us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394951.999680:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787394951.999750:0:8324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8324:1874219323389312:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787394951.999769:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787394951.999921:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787394951.999940:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787394951.999950:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394951.999975:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394951.999987:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787394951.999990:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787394951.999993:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787394952.000016:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394952.000025:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394952.000035:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394952.000049:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787394952.000077:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394952.000099:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787394952.000140:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389440 00000100:00100000:3.0:1787394952.000145:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389440 00000100:00100000:3.0:1787394952.000176:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787394952.000183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323389440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787394952.000190:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394952.000202:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a7fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7fb9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394952.000229:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a7fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fb9 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394952.000239:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a7fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fb9 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394952.000248:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55da00, rc 0) 00000100:00100000:3.0:1787394952.000277:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323389440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394952.000290:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787394952.000613:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787394952.000626:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394952.000636:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394952.000681:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394952.000707:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394952.000737:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787394952.000833:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389568 00000100:00100000:3.0:1787394952.000837:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389568 00000100:00100000:3.0:1787394952.000872:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787394952.000890:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323389568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394952.001137:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323389568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394952.001144:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787394952.001367:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394952.001398:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394952.001435:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394952.001454:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787394952.001508:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389696 00000100:00100000:1.0:1787394952.001512:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389696 00000100:00100000:1.0:1787394952.001545:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787394952.001553:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323389696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787394952.001689:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323389696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394952.001701:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787394952.001773:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323389696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394952.002136:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8325:1874219323389824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394952.002173:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394952.002196:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787394952.002365:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389824 00000100:00100000:1.0:1787394952.002370:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389824 00000100:00100000:1.0:1787394952.002397:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787394952.002404:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8325:x1874219323389824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787394952.002570:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8325:x1874219323389824:12345-0@lo:502:llog_process_th.0 Request processed in 166us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394952.002577:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787394952.002619:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8325:1874219323389824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787394952.002642:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787394952.002651:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394952.002653:0:8325:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787394952.002659:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787394952.002680:0:8325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8325:1874219323389952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787394952.002713:0:8325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394952.002732:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323389952 00000100:00100000:1.0:1787394952.002736:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323389952 00000100:00100000:1.0:1787394952.002754:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787394952.002760:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8325:x1874219323389952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787394952.002889:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8325:x1874219323389952:12345-0@lo:502:llog_process_th.0 Request processed in 116us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394952.002896:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787394952.002923:0:8325:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192900 going to sleep for 11 seconds 00000100:00100000:1.0:1787394952.002936:0:8325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8325:1874219323389952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787394952.002954:0:8325:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394952.002962:0:8325:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394952.002964:0:8325:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787394952.002967:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787394952.003012:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787394952.003030:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787394952.003040:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003049:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394952.003059:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787394952.003061:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0b3181099c0 from 1 10000000:01000000:1.0:1787394952.003064:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787394952.003087:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003094:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003102:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394952.003282:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323390080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787394952.003335:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394952.003348:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192900 going to sleep for 11 seconds 00000100:00100000:1.0:1787394952.003361:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390080 00000100:00100000:1.0:1787394952.003364:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390080 00000100:00100000:1.0:1787394952.003383:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787394952.003389:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323390080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394952.003407:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394952.003418:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167c00/0xedbabbe2e89a7fce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7fc7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003438:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167c00/0xedbabbe2e89a7fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fc7 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003447:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167c00/0xedbabbe2e89a7fce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fc7 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003456:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167c00, rc 0) 00000100:00100000:1.0:1787394952.003482:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323390080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394952.003488:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787394952.003516:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323390080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394952.003526:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003533:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394952.003571:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323390208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394952.003592:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394952.003604:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318192900 going to sleep for 11 seconds 00000100:00100000:1.0:1787394952.003614:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390208 00000100:00100000:1.0:1787394952.003617:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390208 00000100:00100000:1.0:1787394952.003632:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787394952.003637:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323390208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394952.003828:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323390208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787394952.003835:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787394952.003862:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323390208:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787394952.003892:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787394952.003898:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394952.003905:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394952.275623:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323390336:0@lo:400:kworker.0 00000100:00100000:1.0:1787394952.275694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394952.276025:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390336 00000100:00100000:0.0:1787394952.276034:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390336 00000100:00100000:0.0:1787394952.276085:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787394952.276095:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323390336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.276942:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323390464:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.276979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394952.277005:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323390976:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394952.277075:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787394952.277081:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323390848:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394952.277127:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323390592:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394952.277160:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787394952.277165:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323390720:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394952.277207:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390976 00000100:00100000:2.0:1787394952.277212:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390976 00000100:00100000:2.0:1787394952.277245:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390720 00000100:00100000:2.0:1787394952.277248:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390720 00000100:00100000:2.0:1787394952.277260:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787394952.277273:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323390976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277327:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323390976:12345-0@lo:400:kworker.0 Request processed in 54us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394952.277334:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787394952.277349:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787394952.277354:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323390720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277381:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323390720:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394952.277386:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787394952.277400:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390464 00000100:00100000:2.0:1787394952.277403:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390464 00000100:00100000:2.0:1787394952.277423:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390848 00000100:00100000:2.0:1787394952.277425:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390848 00000100:00100000:2.0:1787394952.277435:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323390592 00000100:00100000:2.0:1787394952.277437:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323390592 00000100:00100000:2.0:1787394952.277448:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787394952.277453:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323390464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277843:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323390464:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394952.277852:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787394952.277867:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787394952.277874:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323390848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277915:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323390848:12345-0@lo:400:kworker.0 Request processed in 43us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394952.277922:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787394952.277932:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787394952.277938:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323390592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.277970:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323390592:12345-0@lo:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394952.277976:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787394952.277997:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787394952.278002:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787394952.278033:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b0e00 x1874219323390720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394952.278047:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323390720:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.278058:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323390592:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.278088:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323390848:0@lo:400:kworker.0 00000100:00100000:2.0:1787394952.278097:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323390464:0@lo:400:kworker.0 00010000:00080000:2.0:1787394952.278105:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b1880 x1874219323390976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394952.278113:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323390976:0@lo:400:kworker.0 00000100:00100000:0.0:1787394952.278284:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323390336:12345-0@lo:400:kworker.0 Request processed in 2190us (2588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394952.278292:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787394952.279852:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323390336:0@lo:400:kworker.0 00010000:00010000:1.0:1787394952.667722:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394952.786810:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394952.786895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394952.787182:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391104 00000100:00100000:3.0:1787394952.787199:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391104 00000100:00100000:3.0:1787394952.787249:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787394952.787257:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323391104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787394952.787291:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1787394952.787605:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367be680 x1874219323391104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394952.787624:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323391104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787394952.787670:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323391104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 412us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394952.787678:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787394953.088675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394953.088721:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.088761:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489344 00000100:00100000:2.0:1787394953.088770:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489344 00000100:00100000:0.0:1787394953.088846:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.088858:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787394953.088879:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304489344:12345-192.168.203.16@tcp:400: 00000100:00080000:1.0:1787394953.089103:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787394953.089130:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489216 00000100:00100000:1.0:1787394953.089134:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489216 00000100:00100000:1.0:1787394953.089164:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 162 00000100:00100000:1.0:1787394953.089171:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:2365:x1874219304489216:12345-192.168.203.16@tcp:400: 00000100:00100000:1.0:1787394953.089222:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:2365:x1874219304489216:12345-192.168.203.16@tcp:400: Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394953.089228:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 162 00000100:00100000:2.0:1787394953.089386:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304489344:12345-192.168.203.16@tcp:400: Request processed in 520us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394953.089393:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:3.0:1787394953.089424:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489600 00000100:00100000:3.0:1787394953.089430:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489600 00000100:00080000:1.0:1787394953.089482:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787394953.089487:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:3.0:1787394953.089497:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304489600:12345-192.168.203.16@tcp:400: 00000100:00100000:3.0:1787394953.089529:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304489600:12345-192.168.203.16@tcp:400: Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394953.089536:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787394953.089627:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.089781:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489472 00000100:00100000:2.0:1787394953.089786:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489472 00000100:00080000:1.0:1787394953.089898:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787394953.089927:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:2.0:1787394953.089935:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304489472:12345-192.168.203.16@tcp:400: 00000100:00100000:2.0:1787394953.089969:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304489472:12345-192.168.203.16@tcp:400: Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394953.089976:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787394953.420535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394953.420724:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489728 00000100:00100000:1.0:1787394953.420744:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489728 00000100:00100000:1.0:1787394953.420808:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 163 00000100:00100000:1.0:1787394953.420817:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:5579:x1874219304489728:12345-192.168.203.16@tcp:101: 00010000:00010000:1.0:1787394953.420842:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394953.420859:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167a00/0xedbabbe2e89a7fd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc20f6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394953.420896:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167a00/0xedbabbe2e89a7fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20f6 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394953.420909:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167a00/0xedbabbe2e89a7fd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20f6 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394953.420918:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167a00, rc 0) 00000100:00100000:1.0:1787394953.420977:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304489728:12345-192.168.203.16@tcp:101: Request processed in 160us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394953.420984:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 163 00000100:00100000:3.0:1787394953.428131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.432885:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489856 00000100:00100000:2.0:1787394953.432899:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489856 00000100:00100000:2.0:1787394953.432976:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:2.0:1787394953.432988:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304489856:12345-192.168.203.16@tcp:501: 00000100:00100000:2.0:1787394953.434960:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304489856:12345-192.168.203.16@tcp:501: Request processed in 1965us (6829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394953.434974:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:2.0:1787394953.439392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394953.439569:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304489984 00000100:00100000:0.0:1787394953.439579:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304489984 00000100:00100000:0.0:1787394953.439707:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:0.0:1787394953.439718:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304489984:12345-192.168.203.16@tcp:503: 00000100:00100000:0.0:1787394953.440965:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304489984:12345-192.168.203.16@tcp:503: Request processed in 1244us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394953.440985:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:0.0:1787394953.453519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.455908:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490112 00000100:00100000:2.0:1787394953.455922:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490112 00000100:00100000:2.0:1787394953.456168:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:2.0:1787394953.456180:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:6058:x1874219304490112:12345-192.168.203.16@tcp:502: 00000100:00100000:2.0:1787394953.456499:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:6058:x1874219304490112:12345-192.168.203.16@tcp:502: Request processed in 319us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394953.456507:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:3.0:1787394953.461149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394953.461246:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490240 00000100:00100000:0.0:1787394953.461255:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490240 00000100:00100000:0.0:1787394953.461349:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:0.0:1787394953.461359:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:6058:x1874219304490240:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787394953.461619:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:6058:x1874219304490240:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 260us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394953.461627:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:3.0:1787394953.467028:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394953.467188:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490368 00000100:00100000:2.0:1787394953.467212:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490368 00000100:00100000:2.0:1787394953.467281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:2.0:1787394953.467293:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304490368:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787394953.467345:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394953.467366:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7fdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc20fd expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394953.467396:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20fd expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394953.467407:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7fdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20fd expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394953.467416:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48000, rc 0) 00000100:00100000:2.0:1787394953.467491:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490368:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 200us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394953.467498:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:3.0:1787394953.475300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394953.475443:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490496 00000100:00100000:1.0:1787394953.475459:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490496 00000100:00100000:1.0:1787394953.475529:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 169 00000100:00100000:1.0:1787394953.475541:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490496:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394953.475807:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490496:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 267us (521us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787394953.475815:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 169 00010000:00010000:1.0:1787394953.683694:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394954.707164:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787394954.908279:0:8364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffdec22c2a0 00000020:00000080:1.0:1787394954.908295:0:8364:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787394954.908300:0:8364:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787394954.908513:0:8364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdec22e530 20000000:00000080:1.0:1787394954.908521:0:8364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b33f67b000 uarg=0000000000000000 20000000:01000000:1.0:1787394954.908555:0:8364:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787394954.908562:0:8364:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787394954.908566:0:8364:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787394954.910350:0:8365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787394954.910633:0:8364:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1787394954.918277:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1787394954.918596:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1787394954.918658:0:8364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1787394954.918676:0:8364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787394954.918697:0:8364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918716:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918723:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918729:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918737:0:8364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918745:0:8364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918798:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918813:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 9 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.918828:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391232:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787394954.918968:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.918977:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 18 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.918986:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391360:0@lo:104: 00000100:00100000:3.0:1787394954.919022:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394954.919056:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.919065:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 18 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.919073:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391488:0@lo:104: 00000100:00100000:3.0:1787394954.919094:0:8364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787394954.919113:0:8364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394954.919121:0:8364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 18 pid: 5797 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.919130:0:8364:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391616:0@lo:104: 00000100:00100000:3.0:1787394954.919146:0:8364:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787394954.919258:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787394954.919277:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394954.919288:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391360 00000100:00100000:1.0:1787394954.919293:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391360 00000100:00100000:1.0:1787394954.919349:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391488 00000100:00100000:1.0:1787394954.919352:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391488 00000100:00100000:1.0:1787394954.919362:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391616 00000100:00100000:1.0:1787394954.919364:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391616 00000100:00100000:1.0:1787394954.919391:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787394954.919399:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:8364:x1874219323391360:12345-0@lo:104: 00010000:00010000:1.0:1787394954.919411:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919460:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787394954.919466:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:8364:x1874219323391360:12345-0@lo:104: Request processed in 69us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.919473:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787394954.919489:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787394954.919495:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f678c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:8364:x1874219323391488:12345-0@lo:104: 00010000:00010000:1.0:1787394954.919502:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919530:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787394954.919534:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f678c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:8364:x1874219323391488:12345-0@lo:104: Request processed in 40us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.919547:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787394954.919574:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787394954.919580:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:8364:x1874219323391616:12345-0@lo:104: 00010000:00010000:1.0:1787394954.919587:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919618:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787394954.919622:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:8364:x1874219323391616:12345-0@lo:104: Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.919628:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787394954.919642:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787394954.919648:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919655:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030a00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394954.919659:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919668:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394954.919675:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394954.919680:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787394954.919703:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919709:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394954.919732:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919739:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300030a00/0xedbabbe2e89a7e7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7e85 expref: -99 pid: 7486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919750:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787394954.919753:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919760:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148e600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394954.919763:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919770:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394954.919776:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394954.919782:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787394954.919794:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919799:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394954.919810:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919816:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148e600/0xedbabbe2e89a7db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7dba expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919824:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787394954.919833:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919839:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342045400 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787394954.919841:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919849:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787394954.919855:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394954.919872:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787394954.919887:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919893:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787394954.919899:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919905:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342045400/0xedbabbe2e89a7d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7d6d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.919918:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394954.919920:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394954.919922:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394954.919928:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394954.919945:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323391744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787394954.919974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394954.920002:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323391872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787394954.920028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394954.920044:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787394954.920049:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323392000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787394954.920065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394954.920085:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391744 00000100:00100000:1.0:1787394954.920088:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391744 00010000:00010000:1.0:1787394954.920105:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 19 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394954.920118:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323391872 00000100:00100000:1.0:1787394954.920121:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323391872 00010000:00010000:1.0:1787394954.920130:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 20 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394954.920139:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392000 00000100:00100000:1.0:1787394954.920141:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392000 00010000:00010000:1.0:1787394954.920150:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 21 pid: 5797 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394954.920160:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787394954.920166:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+21:3306:x1874219323391744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787394954.920174:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394954.920178:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 21 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920188:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 21 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920202:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394954.920226:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+21:3306:x1874219323391744:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.920238:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787394954.920251:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787394954.920257:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3303:x1874219323391872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787394954.920263:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394954.920268:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 20 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920275:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 20 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920285:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394954.920328:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3303:x1874219323391872:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.920334:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787394954.920344:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787394954.920350:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323392000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787394954.920356:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394954.920360:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 19 pid: 5797 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920368:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 19 pid: 5797 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.920377:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394954.920397:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323392000:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.920402:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787394954.920434:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323391744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787394954.920464:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323392000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787394954.920471:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323391872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787394954.920705:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342166a00/0xedbabbe2e89a7e85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7e7e expref: 18 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.920717:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391360:0@lo:104: 00010000:00010000:3.0:1787394954.920726:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a7dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7db3 expref: 17 pid: 5795 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.920740:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391488:0@lo:104: 00010000:00010000:3.0:1787394954.920750:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b30148ee00/0xedbabbe2e89a7d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7d66 expref: 16 pid: 5797 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394954.920760:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391616:0@lo:104: 00010000:00010000:0.0:1787394954.920853:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394954.924098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394954.924201:0:8364:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8364:1874219323391232:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787394954.924237:0:8364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394954.924391:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490624 00000100:00100000:1.0:1787394954.924399:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490624 00010000:00010000:1.0:1787394954.924431:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394954.924465:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:1.0:1787394954.924474:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2364:x1874219304490624:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787394954.924489:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787394954.924495:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924507:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924524:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a7f42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20c5 expref: 10 pid: 5797 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924539:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924547:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924562:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924570:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924587:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924594:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924601:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787394954.924605:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924612:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924623:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394954.924632:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787394954.924678:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:2364:x1874219304490624:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 205us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394954.924685:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00010000:00010000:0.0:1787394954.924924:0:8364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394954.924933:0:8364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394954.924939:0:8364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a7fe3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394955.735970:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787394956.632455:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787394956.632467:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f645800 from 4 10000000:01000000:3.0:1787394956.632475:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787394956.632548:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394956.632562:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394956.632584:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394956.632629:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.632720:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.632776:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2033883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.634059:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392128 00000100:00100000:2.0:1787394956.634077:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392128 00000100:00100000:2.0:1787394956.634156:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787394956.634167:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323392128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787394956.634188:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394956.634215:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7fea expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.634250:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.634286:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.634298:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48200, rc 0) 00000100:00100000:2.0:1787394956.634407:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.634415:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787394956.634791:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787394956.634812:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394956.634823:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787394956.634931:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.634969:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.635015:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2033883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.635160:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392256 00000100:00100000:2.0:1787394956.635165:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392256 00000100:00100000:2.0:1787394956.635203:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787394956.635210:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.636767:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1545us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.636783:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787394956.636972:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.637045:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.637124:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.637156:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2033883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.637257:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392384 00000100:00100000:2.0:1787394956.637265:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392384 00000100:00100000:2.0:1787394956.638735:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787394956.638762:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.639084:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.639094:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787394956.642674:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.645913:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8434:1874219323392512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394956.646043:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.646111:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b203388d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787394956.646182:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392512 00000100:00100000:0.0:1787394956.646191:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392512 00000100:00100000:0.0:1787394956.646254:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787394956.646266:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8434:x1874219323392512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.646607:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8434:x1874219323392512:12345-0@lo:502:llog_process_th.0 Request processed in 334us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394956.646616:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787394956.647553:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8434:1874219323392512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787394956.647952:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787394956.647969:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394956.647972:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787394956.647981:0:8434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b33f645800 00000020:00000080:3.0:1787394956.647984:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787394956.653585:0:8434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8434:1874219323392640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394956.653696:0:8434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.653750:0:8434:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b31857fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394956.654142:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392640 00000100:00100000:0.0:1787394956.654154:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392640 00000100:00100000:0.0:1787394956.654214:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787394956.654225:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8434:x1874219323392640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.654556:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:8434:x1874219323392640:12345-0@lo:502:llog_process_th.0 Request processed in 330us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394956.654565:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787394956.663896:0:8434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8434:1874219323392640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787394956.663958:0:8434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394956.663970:0:8434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394956.663973:0:8434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787394956.663983:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787394956.664184:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787394956.664206:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787394956.664220:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664241:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787394956.664254:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787394956.664257:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b305de9800 from 4 10000000:01000000:1.0:1787394956.664261:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787394956.664493:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664504:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664516:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394956.664544:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.664639:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394956.664682:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787394956.664731:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392768 00000100:00100000:1.0:1787394956.664739:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392768 00000100:00100000:1.0:1787394956.664791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787394956.664800:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323392768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394956.664817:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394956.664832:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a7ff8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664873:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664899:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.664910:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167800, rc 0) 00000100:00100000:1.0:1787394956.664954:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323392768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394956.664963:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787394956.665005:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787394956.665018:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394956.665028:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787394956.665088:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.665113:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394956.665128:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787394956.665149:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323392896 00000100:00100000:1.0:1787394956.665153:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323392896 00000100:00100000:1.0:1787394956.665173:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787394956.665179:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323392896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.665509:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323392896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 327us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394956.665517:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787394956.665553:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323392896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.665595:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.665635:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394956.665648:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787394956.665659:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393024 00000100:00100000:1.0:1787394956.665663:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393024 00000100:00100000:1.0:1787394956.665684:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787394956.665690:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323393024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787394956.665857:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323393024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394956.665865:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787394956.665905:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787394956.666363:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8437:1874219323393152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.666406:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394956.666430:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393152 00000100:00100000:0.0:1787394956.666435:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393152 00000100:00100000:0.0:1787394956.666463:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787394956.666469:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8437:x1874219323393152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.666620:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8437:x1874219323393152:12345-0@lo:502:llog_process_th.0 Request processed in 150us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394956.666627:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787394956.666671:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffeccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394956.666686:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8437:1874219323393152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787394956.666713:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787394956.666724:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787394956.666727:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787394956.666736:0:8437:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b305de9800 00000020:00000080:0.0:1787394956.666739:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787394956.670048:0:8437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8437:1874219323393280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.670160:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394956.670204:0:8437:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30302b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787394956.675677:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393280 00000100:00100000:3.0:1787394956.675698:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393280 00000100:00100000:3.0:1787394956.675772:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787394956.675784:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8437:x1874219323393280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394956.676145:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:8437:x1874219323393280:12345-0@lo:502:llog_process_th.0 Request processed in 362us (5984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394956.676155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787394956.676473:0:8437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8437:1874219323393280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787394956.676521:0:8437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787394956.676544:0:8437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787394956.676547:0:8437:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787394956.676562:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787394956.676811:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787394956.676837:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787394956.676864:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394956.676878:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787394956.676892:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787394956.676895:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b318a89000 from 4 10000000:01000000:0.0:1787394956.676899:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787394956.676942:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394956.676951:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394956.676963:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787394956.676990:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787394956.677042:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394956.677091:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffeccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.677184:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393408 00000100:00100000:2.0:1787394956.677191:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393408 00000100:00100000:2.0:1787394956.677244:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787394956.677253:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323393408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787394956.677267:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394956.677281:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a8006 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.677353:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.677366:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.677377:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49400, rc 0) 00000100:00100000:2.0:1787394956.677416:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323393408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.677424:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787394956.677484:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787394956.677498:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.677508:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394956.677702:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.677730:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394956.677766:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787394956.677806:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393536 00000100:00100000:0.0:1787394956.677810:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393536 00000100:00100000:0.0:1787394956.677841:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787394956.677857:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323393536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787394956.678169:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323393536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394956.678178:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787394956.680950:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.681032:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.681128:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394956.681179:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.681208:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393664 00000100:00100000:2.0:1787394956.681214:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393664 00000100:00100000:2.0:1787394956.681277:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787394956.681287:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323393664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.681748:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323393664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 460us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.681759:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787394956.682724:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323393664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.683073:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8439:1874219323393792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394956.683149:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.683198:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787394956.685773:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393792 00000100:00100000:0.0:1787394956.685796:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393792 00000100:00100000:0.0:1787394956.685908:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787394956.685921:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:8439:x1874219323393792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787394956.686276:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:8439:x1874219323393792:12345-0@lo:502:llog_process_th.0 Request processed in 357us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394956.686285:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787394956.686509:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8439:1874219323393792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787394956.686571:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787394956.686584:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787394956.686586:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787394956.686594:0:8439:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b318a89000 00000020:00000080:3.0:1787394956.686597:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787394956.687150:0:8439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8439:1874219323393920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787394956.687210:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394956.687251:0:8439:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787394956.687448:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323393920 00000100:00100000:2.0:1787394956.687456:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323393920 00000100:00100000:2.0:1787394956.687506:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787394956.687516:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:8439:x1874219323393920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787394956.690278:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:8439:x1874219323393920:12345-0@lo:502:llog_process_th.0 Request processed in 2751us (3055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.690296:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787394956.696505:0:8439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:8439:1874219323393920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787394956.696573:0:8439:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787394956.696585:0:8439:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787394956.696588:0:8439:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787394956.696598:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787394956.697409:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787394956.697438:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787394956.697453:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.697468:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787394956.738106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394956.738150:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490752 00000100:00100000:2.0:1787394956.738161:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490752 00000100:00100000:2.0:1787394956.738220:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 185 00000100:00100000:2.0:1787394956.738232:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:5579:x1874219304490752:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787394956.738254:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787394956.738277:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2104 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.738328:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.738341:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787394956.738353:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48400, rc 0) 00000100:00100000:2.0:1787394956.738426:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490752:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 197us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.738435:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 185 00000100:00100000:3.0:1787394956.745567:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394956.745614:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304490880 00000100:00100000:3.0:1787394956.745627:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304490880 00000100:00100000:3.0:1787394956.745705:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 186 00000100:00100000:3.0:1787394956.745717:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490880:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787394956.746094:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304490880:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 378us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394956.746104:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 186 00000100:00100000:1.0:1787394956.751808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394956.751887:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491008 00000100:00100000:2.0:1787394956.751901:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491008 00000100:00100000:2.0:1787394956.751975:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 187 00000100:00100000:2.0:1787394956.751987:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304491008:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787394956.755012:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:5579:x1874219304491008:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 3015us (3206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.755030:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 187 00010000:00010000:2.0:1787394956.755749:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394956.761011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394956.761230:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491136 00000100:00100000:1.0:1787394956.761247:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491136 00000100:00100000:1.0:1787394956.761354:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 188 00000100:00100000:1.0:1787394956.761369:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:6121:x1874219304491136:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787394956.761736:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:6121:x1874219304491136:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 369us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394956.761746:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 188 00000100:00100000:1.0:1787394956.766163:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394956.766562:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491264 00000100:00100000:2.0:1787394956.766584:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491264 00000100:00100000:2.0:1787394956.766646:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00100000:2.0:1787394956.766655:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:6121:x1874219304491264:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787394956.767103:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:6121:x1874219304491264:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 446us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.767398:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00100000:3.0:1787394956.882896:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323394048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394956.883009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394956.883068:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394048 00000100:00100000:2.0:1787394956.883079:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394048 00000100:00100000:2.0:1787394956.883156:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787394956.883168:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323394048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787394956.883215:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394956.885200:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323394048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2021us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394956.885217:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787394956.885275:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787394956.885455:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bf100 x1874219323394048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394956.885487:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323394048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394957.396947:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323394560:0@lo:400:kworker.0 00000100:00100000:3.0:1787394957.397128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394957.397203:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787394957.397210:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323394176:0@lo:400:kworker.0 00000100:00100000:3.0:1787394957.397242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394957.397264:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323394688:0@lo:400:kworker.0 00000100:00100000:3.0:1787394957.397290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394957.397366:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394560 00000100:00100000:3.0:1787394957.397376:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394560 00000100:00100000:3.0:1787394957.397435:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787394957.397445:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323394560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394957.397508:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323394560:12345-0@lo:400:kworker.0 Request processed in 63us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394957.397516:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787394957.397546:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394688 00000100:00100000:3.0:1787394957.397550:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394688 00000100:00100000:3.0:1787394957.397590:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787394957.397596:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323394688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394957.397625:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323394688:12345-0@lo:400:kworker.0 Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394957.397631:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787394957.397668:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394957.397707:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323394688:0@lo:400:kworker.0 00010000:00080000:3.0:1787394957.397721:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336225c00 x1874219323394560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394957.397732:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323394560:0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398190:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323394304:0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398228:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394957.398248:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323394816:0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398267:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394957.398286:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787394957.398292:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323394432:0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398344:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394957.398369:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394176 00000100:00100000:1.0:1787394957.398373:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394176 00000100:00100000:1.0:1787394957.398404:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787394957.398411:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323394176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398451:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323394176:12345-0@lo:400:kworker.0 Request processed in 41us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394957.398458:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787394957.398538:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394304 00000100:00100000:1.0:1787394957.398542:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394304 00000100:00100000:1.0:1787394957.398561:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394432 00000100:00100000:1.0:1787394957.398564:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394432 00000100:00100000:1.0:1787394957.398583:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787394957.398589:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323394304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398617:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323394304:12345-0@lo:400:kworker.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394957.398623:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787394957.398632:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787394957.398637:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323394432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398657:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323394432:12345-0@lo:400:kworker.0 Request processed in 20us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394957.398670:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787394957.398686:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394816 00000100:00100000:1.0:1787394957.398688:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394816 00000100:00100000:1.0:1787394957.398710:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787394957.398715:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323394816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394957.398741:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323394816:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394957.398746:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787394957.399394:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323394432:0@lo:400:kworker.0 00000100:00100000:0.0:1787394957.399412:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323394304:0@lo:400:kworker.0 00010000:00080000:0.0:1787394957.399427:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336227100 x1874219323394816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394957.399439:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323394816:0@lo:400:kworker.0 00000100:00080000:0.0:1787394957.399481:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787394957.399487:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394957.399582:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323394176:0@lo:400:kworker.0 00010000:00010000:0.0:1787394957.778763:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394957.907183:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787394957.907215:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323394944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787394957.907336:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394957.907649:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323394944 00000100:00100000:0.0:1787394957.907660:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323394944 00000100:00100000:0.0:1787394957.907793:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787394957.907805:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323394944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787394957.907862:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394957.907932:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323394944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394957.907962:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787394957.908179:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323394944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394957.908208:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323394944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394958.211788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394958.211830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394958.211877:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491520 00000100:00100000:2.0:1787394958.211878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394958.211892:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491520 00000100:00100000:2.0:1787394958.211921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394958.211954:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491776 00000100:00100000:2.0:1787394958.211959:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491776 00000100:00100000:1.0:1787394958.211986:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:1.0:1787394958.211999:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304491520:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394958.212000:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491648 00000100:00100000:2.0:1787394958.212004:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491648 00000100:00100000:2.0:1787394958.212023:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:2.0:1787394958.212031:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304491776:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787394958.212093:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304491520:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 97us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394958.212101:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1787394958.212131:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787394958.212142:0:6599:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787394958.212237:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491392 00000100:00100000:0.0:1787394958.212243:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491392 00000100:00100000:0.0:1787394958.212281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 191 00000100:00100000:3.0:1787394958.212286:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787394958.212292:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2364:x1874219304491392:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394958.212302:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304491648:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394958.213002:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304491776:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 970us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394958.213012:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00080000:1.0:1787394958.213761:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787394958.213768:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787394958.213772:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787394958.213868:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2364:x1874219304491392:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1577us (1986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394958.213879:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 191 00000100:00100000:3.0:1787394958.213901:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304491648:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1601us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394958.213913:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:3.0:1787394958.802431:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394959.826433:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394960.853602:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787394961.073970:0:8665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787394961.877752:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394962.012346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323395072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787394962.012424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394962.016827:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395072 00000100:00100000:0.0:1787394962.016844:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395072 00000100:00100000:0.0:1787394962.016914:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787394962.016925:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323395072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787394962.016966:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394962.017047:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323395072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394962.017055:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787394962.017075:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787394962.017112:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323395072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394962.017133:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323395072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394962.523213:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323395200:0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.523290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394962.523351:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323395712:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.523746:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323395328:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.523781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394962.523804:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323395840:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.523840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394962.523864:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394962.523870:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323395456:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.523890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394962.523912:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323395584:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.523934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394962.524060:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395328 00000100:00100000:0.0:1787394962.524069:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395328 00000100:00100000:3.0:1787394962.524082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394962.524120:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395200 00000100:00100000:3.0:1787394962.524124:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395200 00000100:00100000:0.0:1787394962.524124:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395456 00000100:00100000:0.0:1787394962.524140:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395456 00000100:00100000:3.0:1787394962.524150:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787394962.524160:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395712 00000100:00100000:0.0:1787394962.524163:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395712 00000100:00100000:0.0:1787394962.524177:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787394962.524183:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323395328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524217:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323395200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394962.524238:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323395328:12345-0@lo:400:kworker.0 Request processed in 56us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394962.524246:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787394962.524248:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323395200:12345-0@lo:400:kworker.0 Request processed in 91us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394962.524261:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787394962.524263:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787394962.524267:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323395456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524291:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787394962.524291:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323395456:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394962.524297:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787394962.524298:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323395712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787394962.524331:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394962.524340:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323395712:12345-0@lo:400:kworker.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394962.524345:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787394962.524378:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323395200:0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524390:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323395712:0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524484:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395840 00000100:00100000:3.0:1787394962.524488:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395840 00000100:00100000:3.0:1787394962.524519:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787394962.524525:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323395840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524558:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323395840:12345-0@lo:400:kworker.0 Request processed in 33us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394962.524564:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787394962.524578:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787394962.524614:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323395456:0@lo:400:kworker.0 00000100:00100000:3.0:1787394962.524623:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323395328:0@lo:400:kworker.0 00010000:00080000:3.0:1787394962.524633:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336227480 x1874219323395840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394962.524642:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323395840:0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.526029:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395584 00000100:00100000:2.0:1787394962.526037:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395584 00000100:00100000:2.0:1787394962.526130:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787394962.526139:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323395584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394962.526202:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323395584:12345-0@lo:400:kworker.0 Request processed in 64us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394962.526209:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787394962.530483:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336224a80 x1874219323395584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394962.530521:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323395584:0@lo:400:kworker.0 00010000:00010000:3.0:1787394962.898664:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394963.029005:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323395968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394963.029070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394963.029156:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323395968 00000100:00100000:1.0:1787394963.029164:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323395968 00000100:00100000:1.0:1787394963.029219:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787394963.029228:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323395968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787394963.029264:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394963.029616:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323395968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 389us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394963.029625:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787394963.029793:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323395968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394963.029827:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323395968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394963.329106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394963.329702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394963.329739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394963.329779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394963.329819:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492160 00000100:00100000:3.0:1787394963.329829:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492160 00000100:00100000:3.0:1787394963.329889:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492288 00000100:00100000:3.0:1787394963.329893:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492288 00000100:00100000:3.0:1787394963.329917:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:3.0:1787394963.329927:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304492160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394963.329993:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304492160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394963.330000:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:3.0:1787394963.330015:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787394963.330021:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304492288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394963.330045:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304492288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394963.330051:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00080000:3.0:1787394963.330067:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787394963.330071:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787394963.330131:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492032 00000100:00100000:0.0:1787394963.330136:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492032 00000100:00100000:0.0:1787394963.330178:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:0.0:1787394963.330185:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304492032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394963.330223:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304492032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394963.330231:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:1.0:1787394963.330236:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304491904 00000100:00100000:1.0:1787394963.330243:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304491904 00000100:00100000:1.0:1787394963.330286:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 193 00000100:00100000:1.0:1787394963.330295:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304491904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787394963.330360:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304491904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 67us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394963.330368:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 193 00000100:00080000:3.0:1787394963.332932:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787394963.923984:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394964.950278:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394965.970526:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787394966.212127:0:8909:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing yml_node 00010000:00010000:0.0:1787394966.999675:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394967.123485:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323396096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787394967.123565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394967.123644:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396096 00000100:00100000:0.0:1787394967.123651:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396096 00000100:00100000:0.0:1787394967.123706:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787394967.123721:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323396096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787394967.123755:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394967.123816:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323396096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394967.123824:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1787394967.123844:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787394967.123873:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3367bc700 x1874219323396096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394967.123890:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323396096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787394967.639446:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323396224:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.639517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394967.639561:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323396736:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.639588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394967.639628:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787394967.639635:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323396608:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.639709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394967.639758:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396736 00000100:00100000:2.0:1787394967.639782:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396736 00000100:00100000:0.0:1787394967.639784:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323396352:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.639808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394967.639826:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787394967.639831:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323396480:0@lo:400:kworker.0 00000100:00100000:2.0:1787394967.639834:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787394967.639843:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323396736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.639849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394967.639910:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323396736:12345-0@lo:400:kworker.0 Request processed in 52us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394967.639918:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787394967.640052:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396224 00000100:00100000:0.0:1787394967.640057:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396224 00000100:00100000:0.0:1787394967.640096:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787394967.640103:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323396224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.640145:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323396224:12345-0@lo:400:kworker.0 Request processed in 43us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394967.640151:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787394967.640177:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396608 00000100:00100000:0.0:1787394967.640181:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396608 00000100:00100000:0.0:1787394967.640212:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396352 00000100:00100000:0.0:1787394967.640215:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396352 00000100:00100000:0.0:1787394967.640228:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396480 00000100:00100000:0.0:1787394967.640230:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396480 00000100:00100000:0.0:1787394967.640244:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787394967.640250:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323396608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.640840:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323396608:12345-0@lo:400:kworker.0 Request processed in 589us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394967.643892:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787394967.643920:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323396352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.643956:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787394967.644022:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323396352:12345-0@lo:400:kworker.0 Request processed in 115us (4211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394967.644029:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787394967.644055:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787394967.644063:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323396480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394967.644093:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323396480:12345-0@lo:400:kworker.0 Request processed in 30us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394967.644098:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787394967.644174:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787394967.644180:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787394967.644232:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323396480:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.644245:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323396352:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.644401:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323396608:0@lo:400:kworker.0 00000100:00100000:0.0:1787394967.644413:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323396224:0@lo:400:kworker.0 00010000:00080000:0.0:1787394967.644429:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b202ce0700 x1874219323396736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394967.644440:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323396736:0@lo:400:kworker.0 00010000:00010000:3.0:1787394968.019250:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394968.147416:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787394968.147441:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323396864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787394968.147511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394968.147738:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396864 00000100:00100000:0.0:1787394968.147745:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396864 00000100:00100000:0.0:1787394968.147819:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787394968.147829:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323396864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787394968.147864:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394968.147919:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323396864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394968.147926:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787394968.148003:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b202ce0700 x1874219323396864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394968.148021:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323396864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787394968.454968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394968.455058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394968.458200:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394968.458286:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394968.458324:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492416 00000100:00100000:0.0:1787394968.458332:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492544 00000100:00100000:3.0:1787394968.458334:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492416 00000100:00100000:0.0:1787394968.458339:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492544 00000100:00100000:3.0:1787394968.458396:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 195 00000100:00100000:0.0:1787394968.458402:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:3.0:1787394968.458411:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304492416:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394968.458416:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304492544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394968.459662:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304492544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394968.459674:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00080000:0.0:1787394968.459710:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394968.460273:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492672 00000100:00100000:2.0:1787394968.460281:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492672 00000100:00100000:1.0:1787394968.460393:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492800 00000100:00100000:1.0:1787394968.460398:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492800 00000100:00100000:1.0:1787394968.460432:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:1.0:1787394968.460441:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2362:x1874219304492672:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:1.0:1787394968.460470:0:8490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f50 00000100:00080000:1.0:1787394968.460478:0:8490:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787394968.460506:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787394968.461567:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304492416:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3153us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394968.461580:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 195 00000100:00080000:0.0:1787394968.461660:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787394968.461664:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787394968.461693:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394968.461711:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787394968.461722:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2362:x1874219304492800:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1787394968.461822:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f57 00000100:00080000:0.0:1787394968.461833:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b3108b6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787394968.461867:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787394968.462502:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394968.462662:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+2:2362:x1874219304492672:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 2220us (7701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394968.462684:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787394968.462700:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+2:2362:x1874219304492800:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 981us (7641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394968.462712:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00010000:00010000:3.0:1787394969.043000:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394970.067177:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787394970.244413:0:9101:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.108 00010000:00010000:2.0:1787394971.092358:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394972.119094:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394972.255139:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323396992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787394972.255282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394972.255502:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323396992 00000100:00100000:2.0:1787394972.255511:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323396992 00000100:00100000:2.0:1787394972.255656:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787394972.255670:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323396992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787394972.255787:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394972.255959:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323396992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394972.255969:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787394972.255999:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787394972.256036:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b202ce0e00 x1874219323396992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394972.256058:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323396992:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787394972.325373:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:0.0:1787394972.325383:0:6626:0:(genops.c:906:class_export_put()) final put ffffa0b33fa8b000/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:0.0:1787394972.325416:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fa8b000/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-OST0000 00000020:00000080:0.0:1787394972.325464:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b327f7d000 for lustre-OST0000 00000001:02000400:0.0:1787394972.548531:0:9200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.108 00000100:00100000:3.0:1787394972.757786:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323397120:0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.757849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394972.757890:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323397632:0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.757911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394972.757933:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787394972.757938:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323397248:0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.757957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394972.760702:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323397376:0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.760784:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323397504:0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.760815:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397120 00000100:00100000:2.0:1787394972.760823:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397120 00000100:00100000:2.0:1787394972.760871:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787394972.760880:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323397120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.760932:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323397120:12345-0@lo:400:kworker.0 Request processed in 53us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394972.760939:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787394972.760992:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397632 00000100:00100000:2.0:1787394972.760996:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397632 00000100:00100000:2.0:1787394972.761029:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787394972.761036:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323397632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.761069:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323397632:12345-0@lo:400:kworker.0 Request processed in 33us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394972.761075:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787394972.761095:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787394972.762244:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323397120:0@lo:400:kworker.0 00010000:00080000:3.0:1787394972.762514:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336224000 x1874219323397632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394972.762527:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323397632:0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.762562:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397248 00000100:00100000:3.0:1787394972.762567:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397248 00000100:00100000:3.0:1787394972.762608:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787394972.762616:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323397248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.762675:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323397248:12345-0@lo:400:kworker.0 Request processed in 60us (4716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394972.762690:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787394972.763153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394972.763195:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397504 00000100:00100000:1.0:1787394972.763200:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397504 00000100:00100000:1.0:1787394972.763238:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787394972.763861:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323397504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394972.763927:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323397504:12345-0@lo:400:kworker.0 Request processed in 682us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394972.763934:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787394972.764697:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787394972.764754:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323397504:0@lo:400:kworker.0 00000100:00100000:3.0:1787394972.765174:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323397248:0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.767132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394972.767198:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397376 00000100:00100000:2.0:1787394972.767206:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397376 00000100:00100000:2.0:1787394972.767273:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787394972.767284:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323397376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394972.768615:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323397376:12345-0@lo:400:kworker.0 Request processed in 1327us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394972.768627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787394972.768658:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394972.768888:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323397376:0@lo:400:kworker.0 00000001:00100000:0.0:1787394972.804293:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:0.0:1787394972.804301:0:7503:0:(genops.c:906:class_export_put()) final put ffffa0b327f7e000/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:0.0:1787394972.804376:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b327f7e000/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-OST0001 00000020:00000080:0.0:1787394972.804414:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b3108b6800 for lustre-OST0001 00010000:00010000:1.0:1787394973.142625:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394973.267967:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787394973.268041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394973.268417:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397760 00000100:00100000:2.0:1787394973.268425:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397760 00000100:00100000:2.0:1787394973.268472:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787394973.268481:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323397760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787394973.268530:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787394973.268588:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323397760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394973.268595:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787394973.268942:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33ff79f80 x1874219323397760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394973.268962:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323397760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787394973.570748:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394973.570794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394973.570826:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493056 00000100:00100000:0.0:1787394973.570834:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493056 00000100:00100000:0.0:1787394973.570907:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00080000:3.0:1787394973.570910:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787394973.570918:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304493056:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394973.570994:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304493056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394973.571001:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:1.0:1787394973.571054:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304492928 00000100:00100000:1.0:1787394973.571059:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304492928 00000100:00100000:1.0:1787394973.571099:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 197 00000100:00100000:1.0:1787394973.571106:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2366:x1874219304492928:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787394973.571136:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2366:x1874219304492928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394973.571144:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 197 00010000:00010000:0.0:1787394974.162573:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787394974.964538:0:9297:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.108 00010000:00010000:3.0:1787394975.186418:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394976.211142:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787394976.438328:0:9345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 06:36:15 EDT 2026 00010000:00010000:2.0:1787394977.235061:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394977.362687:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394977.362789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394977.362857:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323397888 00000100:00100000:3.0:1787394977.362864:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323397888 00000100:00100000:3.0:1787394977.362911:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787394977.362919:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323397888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787394977.362950:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787394977.362991:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323397888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394977.362998:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787394977.363016:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787394977.363045:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336224000 x1874219323397888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394977.363062:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787394977.875679:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323398016:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.875759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394977.875876:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323398528:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.875904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394977.875938:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787394977.875945:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.875970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394977.875998:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323398272:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394977.876038:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787394977.876043:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323398144:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394977.876091:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398016 00000100:00100000:2.0:1787394977.876098:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398016 00000100:00100000:2.0:1787394977.876140:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787394977.876149:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323398016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876196:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323398016:12345-0@lo:400:kworker.0 Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394977.876204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1787394977.876235:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398400 00000100:00100000:2.0:1787394977.876239:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398400 00000100:00100000:2.0:1787394977.876271:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398272 00000100:00100000:2.0:1787394977.876274:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398272 00000100:00100000:2.0:1787394977.876287:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398144 00000100:00100000:2.0:1787394977.876289:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398144 00000100:00100000:2.0:1787394977.876303:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787394977.876330:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323398400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876372:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323398400:12345-0@lo:400:kworker.0 Request processed in 42us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394977.876378:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787394977.876391:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787394977.876397:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323398272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876427:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323398272:12345-0@lo:400:kworker.0 Request processed in 30us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394977.876433:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787394977.876443:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787394977.876449:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323398144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876554:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323398144:12345-0@lo:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394977.876562:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1787394977.876681:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394977.876724:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323398144:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876736:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323398272:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876766:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323398400:0@lo:400:kworker.0 00000100:00100000:2.0:1787394977.876774:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323398016:0@lo:400:kworker.0 00000100:00100000:3.0:1787394977.877249:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398528 00000100:00100000:3.0:1787394977.877256:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398528 00000100:00080000:2.0:1787394977.877287:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787394977.877329:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787394977.877402:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323398528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394977.877471:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323398528:12345-0@lo:400:kworker.0 Request processed in 134us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394977.877480:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787394977.877774:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291b1880 x1874219323398528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394977.877850:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323398528:0@lo:400:kworker.0 00010000:00010000:3.0:1787394978.258440:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394978.389344:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787394978.389368:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323398656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787394978.389445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394978.389506:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398656 00000100:00100000:1.0:1787394978.389513:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398656 00000100:00100000:1.0:1787394978.389559:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787394978.389578:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323398656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787394978.389616:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394978.389661:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323398656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394978.389669:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1787394978.389719:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae0380 x1874219323398656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394978.389737:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323398656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787394978.691963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394978.692010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394978.692753:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493184 00000100:00100000:0.0:1787394978.692764:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493184 00000100:00100000:0.0:1787394978.692826:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 199 00000100:00100000:0.0:1787394978.692836:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2365:x1874219304493184:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394978.692932:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2365:x1874219304493184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 96us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394978.692940:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 199 00000100:00100000:2.0:1787394978.693219:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493312 00000100:00100000:2.0:1787394978.693231:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493312 00000100:00100000:2.0:1787394978.693293:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:2.0:1787394978.693301:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304493312:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394978.693403:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304493312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 103us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394978.693409:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00080000:0.0:1787394978.694169:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787394979.289945:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394980.306469:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394981.330405:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787394982.354408:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787394982.483624:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323398784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787394982.483705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394982.484455:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398784 00000100:00100000:3.0:1787394982.484465:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398784 00000100:00100000:3.0:1787394982.484535:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787394982.484545:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323398784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787394982.484580:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787394982.484635:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323398784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394982.484642:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787394982.484756:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787394982.484792:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336226a00 x1874219323398784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394982.484813:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323398784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787394982.994491:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323399040:0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.994526:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323399296:0@lo:400:kworker.0 00000100:00100000:0.0:1787394982.994563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394982.994597:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399040 00000100:00100000:2.0:1787394982.994604:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399040 00000100:00100000:0.0:1787394982.994616:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787394982.994623:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323398912:0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.994650:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787394982.994650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394982.994658:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323399040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394982.994688:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323399424:0@lo:400:kworker.0 00000100:00100000:0.0:1787394982.994710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394982.994715:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323399040:12345-0@lo:400:kworker.0 Request processed in 58us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394982.994723:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787394982.994739:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323399040:0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.994751:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399424 00000100:00100000:2.0:1787394982.994755:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399424 00000100:00100000:0.0:1787394982.994762:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323398912 00000100:00100000:0.0:1787394982.994764:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323398912 00000100:00100000:2.0:1787394982.994787:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787394982.994787:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787394982.994794:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323399424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394982.994794:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323398912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.994825:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323399424:12345-0@lo:400:kworker.0 Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394982.994832:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787394982.994847:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787394982.994847:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323399168:0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.994880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394982.994925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394982.994949:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399296 00000100:00100000:2.0:1787394982.994952:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399296 00000100:00100000:1.0:1787394982.994970:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399168 00000100:00100000:1.0:1787394982.994974:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399168 00000100:00100000:2.0:1787394982.994976:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787394982.994990:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323399296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394982.994997:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787394982.995002:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323399168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.995025:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323399296:12345-0@lo:400:kworker.0 Request processed in 36us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394982.995031:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f443b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323399168:12345-0@lo:400:kworker.0 Request processed in 28us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394982.995032:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787394982.995036:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787394982.995047:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394982.995063:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323399168:0@lo:400:kworker.0 00000100:00100000:2.0:1787394982.995100:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323399296:0@lo:400:kworker.0 00000100:00100000:0.0:1787394982.995270:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323398912:12345-0@lo:400:kworker.0 Request processed in 475us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394982.995287:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1787394982.996920:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323398912:0@lo:400:kworker.0 00010000:00080000:2.0:1787394982.996940:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33ff79f80 x1874219323399424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787394998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394982.996951:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323399424:0@lo:400:kworker.0 00010000:00010000:0.0:1787394983.378606:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394983.506619:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787394983.506642:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323399552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787394983.506720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394983.506790:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399552 00000100:00100000:1.0:1787394983.506798:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399552 00000100:00100000:1.0:1787394983.506845:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787394983.506869:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323399552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787394983.506906:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394983.506959:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323399552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394983.506967:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787394983.507123:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae1c00 x1874219323399552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787394999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394983.507140:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323399552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787394983.809442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394983.809482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394983.809546:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493568 00000100:00100000:3.0:1787394983.809557:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493568 00000100:00100000:2.0:1787394983.809575:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493440 00000100:00100000:2.0:1787394983.809581:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493440 00000100:00100000:2.0:1787394983.809648:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 201 00000100:00100000:3.0:1787394983.809653:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787394983.809670:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2366:x1874219304493440:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394983.809678:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304493568:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1787394983.809757:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394983.810360:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2366:x1874219304493440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 699us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394983.810370:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 201 00000100:00100000:3.0:1787394983.810396:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304493568:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 732us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394983.810405:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00010000:00010000:2.0:1787394984.406980:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394985.427032:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787394986.452814:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394987.491775:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394987.607611:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323399680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787394987.607690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394987.607775:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399680 00000100:00100000:1.0:1787394987.607783:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399680 00000100:00100000:1.0:1787394987.607839:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787394987.607849:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323399680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787394987.607884:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787394987.609560:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787394987.613224:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323399680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5367us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394987.613239:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787394987.615278:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336227100 x1874219323399680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394987.615331:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323399680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394988.119573:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323399936:0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.119653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394988.119700:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323400448:0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.119748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394988.119780:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787394988.119786:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323400064:0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.119809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394988.119837:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400448 00000100:00100000:3.0:1787394988.119844:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400448 00000100:00100000:3.0:1787394988.119894:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787394988.119903:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323400448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.119953:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323400448:12345-0@lo:400:kworker.0 Request processed in 50us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394988.119959:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787394988.119979:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787394988.120006:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fb57b80 x1874219323400448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394988.120018:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323400448:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120271:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323399808:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394988.120357:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323400320:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394988.120399:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787394988.120405:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323400192:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120425:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394988.120448:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399936 00000100:00100000:1.0:1787394988.120453:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399936 00000100:00100000:1.0:1787394988.120489:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400064 00000100:00100000:1.0:1787394988.120492:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400064 00000100:00100000:1.0:1787394988.120510:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400320 00000100:00100000:1.0:1787394988.120513:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400320 00000100:00100000:1.0:1787394988.120536:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787394988.120541:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323399936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120579:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323399936:12345-0@lo:400:kworker.0 Request processed in 37us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394988.120585:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787394988.120597:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787394988.120603:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323400064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120642:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323400064:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394988.120648:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787394988.120661:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787394988.120667:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323400320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120696:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323400320:12345-0@lo:400:kworker.0 Request processed in 30us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394988.120702:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787394988.120716:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787394988.120736:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323400064:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120748:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323399936:0@lo:400:kworker.0 00000100:00100000:1.0:1787394988.120775:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fb54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323400320:0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.122943:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323399808 00000100:00100000:3.0:1787394988.122956:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323399808 00000100:00100000:3.0:1787394988.123013:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787394988.123022:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323399808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394988.123100:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323399808:12345-0@lo:400:kworker.0 Request processed in 80us (2794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394988.123107:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787394988.123163:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323399808:0@lo:400:kworker.0 00000100:00100000:2.0:1787394988.125598:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400192 00000100:00100000:2.0:1787394988.125612:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400192 00000100:00100000:2.0:1787394988.125724:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787394988.125735:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323400192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394988.125821:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323400192:12345-0@lo:400:kworker.0 Request processed in 88us (5393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394988.125828:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787394988.128547:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336226a00 x1874219323400192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394988.128566:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323400192:0@lo:400:kworker.0 00010000:00010000:0.0:1787394988.498739:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394988.626936:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394988.626961:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323400576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394988.627028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394988.627169:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400576 00000100:00100000:0.0:1787394988.627178:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400576 00000100:00100000:0.0:1787394988.627385:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787394988.627396:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323400576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787394988.627429:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394988.627495:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323400576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394988.627502:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787394988.627603:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae1c00 x1874219323400576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787394988.627651:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323400576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787394988.937540:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394988.937592:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394988.937677:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493696 00000100:00100000:2.0:1787394988.937687:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493696 00000100:00100000:2.0:1787394988.937748:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 203 00000100:00100000:2.0:1787394988.937759:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304493696:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394988.937850:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304493696:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394988.937858:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 203 00000100:00100000:1.0:1787394988.938182:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493824 00000100:00100000:1.0:1787394988.938187:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493824 00000100:00080000:3.0:1787394988.938237:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787394988.938242:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787394988.938251:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304493824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787394988.938300:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304493824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 51us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394988.938353:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00010000:00010000:0.0:1787394989.523333:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787394990.214555:0:9976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:36:29 (1787394989) === 00010000:00010000:0.0:1787394990.546661:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394990.688583:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.689365:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304493952 00000100:00100000:1.0:1787394990.689376:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304493952 00000100:00100000:1.0:1787394990.689446:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 204 00000100:00100000:1.0:1787394990.689456:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:8115:x1874219304493952:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787394990.689472:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787394990.689491:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a801b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc210b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394990.689672:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc210b expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394990.689686:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a801b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc210b expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787394990.689695:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167400, rc 0) 00000100:00100000:1.0:1787394990.689823:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304493952:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 368us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.689831:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 204 00000100:00100000:0.0:1787394990.695068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.695156:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494080 00000100:00100000:3.0:1787394990.695167:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494080 00000100:00100000:3.0:1787394990.695281:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 205 00000100:00100000:3.0:1787394990.695292:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304494080:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787394990.695660:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304494080:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 369us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394990.695669:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 205 00000100:00100000:0.0:1787394990.704974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.705114:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494208 00000100:00100000:1.0:1787394990.705124:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494208 00000100:00100000:1.0:1787394990.705373:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 206 00000100:00100000:1.0:1787394990.705384:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304494208:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787394990.705639:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304494208:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 256us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.705647:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 206 00000100:00100000:1.0:1787394990.713759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.724118:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494336 00000100:00100000:3.0:1787394990.724135:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494336 00000100:00100000:3.0:1787394990.726129:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 207 00000100:00100000:3.0:1787394990.726151:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8119:x1874219304494336:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787394990.727405:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8119:x1874219304494336:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 1258us (13649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394990.727429:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 207 00000100:00100000:0.0:1787394990.762106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.763181:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494464 00000100:00100000:1.0:1787394990.763195:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494464 00000100:00100000:1.0:1787394990.763456:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 208 00000100:00100000:1.0:1787394990.763471:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8119:x1874219304494464:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787394990.763810:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8119:x1874219304494464:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 342us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.763819:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 208 00000100:00100000:0.0:1787394990.769134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.769234:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494592 00000100:00100000:3.0:1787394990.769246:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494592 00000100:00100000:3.0:1787394990.769336:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00100000:3.0:1787394990.769347:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:8115:x1874219304494592:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787394990.769364:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787394990.769382:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a8022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2135 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394990.769410:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a8022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2135 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394990.769421:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a8022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2135 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787394990.769431:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d400, rc 0) 00000100:00100000:3.0:1787394990.769494:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:8115:x1874219304494592:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 149us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394990.769502:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00100000:3.0:1787394990.779976:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.783689:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494720 00000100:00100000:1.0:1787394990.783704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494720 00000100:00100000:1.0:1787394990.783952:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00100000:1.0:1787394990.784990:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:8115:x1874219304494720:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787394990.785021:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787394990.785043:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787394990.785046:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787394990.785049:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787394990.785051:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787394990.792210:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:8115:x1874219304494720:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 8237us (12231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.792240:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00100000:2.0:1787394990.824070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.829976:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494848 00000100:00100000:0.0:1787394990.829991:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494848 00000100:00100000:0.0:1787394990.830067:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 211 00000100:00100000:0.0:1787394990.830088:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:8115:x1874219304494848:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787394990.830105:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787394990.830124:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc213c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394990.830152:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394990.830163:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787394990.830188:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010a00, rc 0) 00000100:00100000:0.0:1787394990.830264:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8115:x1874219304494848:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 187us (6203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394990.830271:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 211 00000100:00100000:3.0:1787394990.834943:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.836990:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304494976 00000100:00100000:1.0:1787394990.837006:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304494976 00000100:00100000:1.0:1787394990.837071:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 212 00000100:00100000:1.0:1787394990.837082:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8115:x1874219304494976:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787394990.837412:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8115:x1874219304494976:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 330us (2476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.837421:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 212 00000100:00100000:1.0:1787394990.844163:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.844272:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495104 00000100:00100000:3.0:1787394990.844283:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495104 00000100:00100000:3.0:1787394990.844396:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 213 00000100:00100000:3.0:1787394990.844407:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8115:x1874219304495104:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787394990.844653:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8115:x1874219304495104:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 247us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394990.844667:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 213 00000100:00100000:2.0:1787394990.854229:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.854395:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495232 00000100:00100000:0.0:1787394990.854404:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495232 00000100:00100000:0.0:1787394990.854452:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 214 00000100:00100000:0.0:1787394990.854462:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8123:x1874219304495232:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787394990.854780:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8123:x1874219304495232:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 318us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394990.854789:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 214 00000100:00100000:0.0:1787394990.872860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.876072:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495360 00000100:00100000:1.0:1787394990.876088:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495360 00000100:00100000:1.0:1787394990.876156:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:1.0:1787394990.876167:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8123:x1874219304495360:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787394990.876631:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:8123:x1874219304495360:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 464us (3789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.876640:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:1.0:1787394990.888768:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.888885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.891320:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495744 00000100:00100000:3.0:1787394990.891336:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495744 00000100:00080000:1.0:1787394990.891583:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394990.891716:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495488 00000100:00100000:3.0:1787394990.891721:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495488 00000100:00100000:2.0:1787394990.891771:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:2.0:1787394990.891783:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304495744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394990.891875:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304495744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 94us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.891898:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:2.0:1787394990.892438:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787394990.892451:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1874219304495488:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787394990.892477:0:6624:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 907adeaf-e431-466d-a504-1dc9d988b548@192.168.203.16@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1787394990.892513:0:6624:0:(genops.c:1406:class_connect()) connect: client 907adeaf-e431-466d-a504-1dc9d988b548, cookie 0xedbabbe2e89a8030 00000004:00100000:2.0:1787394990.892541:0:6624:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787394990.892830:0:6624:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787394990.893244:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+6:2362:x1874219304495488:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 797us (4356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.893253:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:1.0:1787394990.899071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.899409:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495616 00000100:00100000:0.0:1787394990.899418:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495616 00000100:00100000:0.0:1787394990.899652:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787394990.899661:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:0:x1874219304495616:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787394990.899710:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787394990.899848:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:0:x1874219304495616:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 180us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394990.899857:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787394990.901423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787394990.901608:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304495872 00000100:00100000:2.0:1787394990.901629:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304495872 00000100:00100000:2.0:1787394990.901683:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787394990.901692:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304495872:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787394990.901729:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787394990.901803:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304495872:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 112us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.901811:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00080000:1.0:1787394990.901978:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787394990.918386:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.918542:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496000 00000100:00100000:0.0:1787394990.918551:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496000 00000100:00100000:0.0:1787394990.918620:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:0.0:1787394990.918630:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304496000:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787394990.918728:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304496000:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 100us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394990.918735:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:0.0:1787394990.923177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.923215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.923252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787394990.923440:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496384 00000100:00100000:1.0:1787394990.923451:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496384 00000100:00100000:1.0:1787394990.923523:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:1.0:1787394990.923534:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304496384:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787394990.923888:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787394990.924043:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:907adeaf-e431-466d-a504-1dc9d988b548+6:8115:x1874219304496384:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 509us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394990.924051:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787394990.929001:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496128 00000100:00100000:2.0:1787394990.929016:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496128 00000100:00100000:2.0:1787394990.929064:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496256 00000100:00100000:2.0:1787394990.929067:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496256 00000100:00100000:2.0:1787394990.929100:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787394990.929109:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874219304496128:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787394990.929139:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 907adeaf-e431-466d-a504-1dc9d988b548@192.168.203.16@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1787394990.929189:0:6599:0:(genops.c:1406:class_connect()) connect: client 907adeaf-e431-466d-a504-1dc9d988b548, cookie 0xedbabbe2e89a8037 00002000:00100000:2.0:1787394990.929200:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 907adeaf-e431-466d-a504-1dc9d988b548/ffffa0b33fb4c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787394990.929225:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787394990.929477:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787394990.929507:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787394990.929589:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:907adeaf-e431-466d-a504-1dc9d988b548+6:2362:x1874219304496128:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 480us (6422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.929596:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787394990.929628:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787394990.929632:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2362:x1874219304496256:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787394990.929647:0:6599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 907adeaf-e431-466d-a504-1dc9d988b548@192.168.203.16@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:2.0:1787394990.929663:0:6599:0:(genops.c:1406:class_connect()) connect: client 907adeaf-e431-466d-a504-1dc9d988b548, cookie 0xedbabbe2e89a803e 00002000:00100000:2.0:1787394990.929668:0:6599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 907adeaf-e431-466d-a504-1dc9d988b548/ffffa0b33fb4e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787394990.929682:0:6599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787394990.929811:0:6599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787394990.929827:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787394990.929863:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:907adeaf-e431-466d-a504-1dc9d988b548+6:2362:x1874219304496256:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 229us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.929871:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:0.0:1787394990.936506:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394990.936559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787394990.936749:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496512 00000100:00100000:3.0:1787394990.936760:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496512 00000100:00100000:3.0:1787394990.936818:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 216 00000100:00100000:3.0:1787394990.936828:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304496512:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394990.936911:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304496512:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 84us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394990.937139:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 216 00000100:00100000:2.0:1787394990.937224:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496640 00000100:00100000:2.0:1787394990.937228:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496640 00000100:00100000:2.0:1787394990.937267:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:2.0:1787394990.937275:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304496640:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787394990.937344:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304496640:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394990.937364:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00010000:00010000:0.0:1787394991.570451:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787394992.594924:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394992.723592:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323400704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394992.723682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394992.723763:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400704 00000100:00100000:3.0:1787394992.723771:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400704 00000100:00100000:3.0:1787394992.723828:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787394992.723848:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323400704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787394992.723891:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787394992.723952:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323400704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394992.723960:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787394992.723987:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787394992.723999:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c89180 x1874219323400704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394992.724020:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323400704:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787394992.740982:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00000100:00100000:3.0:1787394993.236853:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323400832:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.236925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.236986:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323401344:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237029:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.237059:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787394993.237071:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323401216:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237099:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.237131:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323400960:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.237179:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323401472:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.237231:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787394993.237240:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323401088:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787394993.237341:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400832 00000100:00100000:3.0:1787394993.237349:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400832 00000100:00100000:3.0:1787394993.237396:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787394993.237410:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323400832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237460:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323400832:12345-0@lo:400:kworker.0 Request processed in 56us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394993.237466:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401216 00000100:00100000:3.0:1787394993.237467:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787394993.237470:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401216 00000100:00100000:3.0:1787394993.237496:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401344 00000100:00100000:3.0:1787394993.237499:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401344 00000100:00100000:3.0:1787394993.237537:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323400960 00000100:00100000:3.0:1787394993.237540:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323400960 00000100:00100000:3.0:1787394993.237562:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401088 00000100:00100000:2.0:1787394993.237562:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401472 00000100:00100000:3.0:1787394993.237565:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401088 00000100:00100000:2.0:1787394993.237565:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401472 00000100:00100000:3.0:1787394993.237589:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787394993.237606:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323401344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237647:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323401344:12345-0@lo:400:kworker.0 Request processed in 51us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394993.237661:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787394993.237676:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787394993.237683:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323400960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323400960:12345-0@lo:400:kworker.0 Request processed in 40us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394993.237728:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787394993.237729:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787394993.237737:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323401216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.237742:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787394993.237748:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323401088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394993.237772:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323401216:12345-0@lo:400:kworker.0 Request processed in 37us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394993.237780:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787394993.237798:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787394993.237804:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323401472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394993.237829:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323401472:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394993.237835:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787394993.238344:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323401088:12345-0@lo:400:kworker.0 Request processed in 594us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394993.238352:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787394993.238485:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c8a680 x1874219323401216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394993.238499:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323401216:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.239127:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323400832:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.239152:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323401344:0@lo:400:kworker.0 00000100:00080000:3.0:1787394993.239182:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787394993.239187:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394993.239209:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323401088:0@lo:400:kworker.0 00000100:00100000:3.0:1787394993.239220:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323400960:0@lo:400:kworker.0 00010000:00080000:3.0:1787394993.239230:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c89f80 x1874219323401472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394993.239238:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323401472:0@lo:400:kworker.0 00000001:00100000:2.0:1787394993.287942:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00000001:00100000:0.0:1787394993.289671:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00010000:00010000:0.0:1787394993.621516:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394993.746533:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394993.746555:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323401600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394993.746628:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394993.746773:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401600 00000100:00100000:0.0:1787394993.746780:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401600 00000100:00100000:0.0:1787394993.746830:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787394993.746839:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323401600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787394993.746870:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787394993.746916:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323401600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394993.746924:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787394993.747348:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336226a00 x1874219323401600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394993.747367:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323401600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787394994.643734:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787394995.084840:0:10173:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787394995.666543:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787394996.097416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394996.097476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394996.097505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394996.097531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394996.097558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787394996.097598:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496896 00000100:00100000:0.0:1787394996.097607:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496896 00000100:00100000:0.0:1787394996.097660:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497024 00000100:00100000:0.0:1787394996.097663:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497024 00000100:00100000:0.0:1787394996.097686:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:0.0:1787394996.097695:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304496896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394996.097768:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304496896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 74us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394996.097776:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:0.0:1787394996.097793:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:0.0:1787394996.097799:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394996.097824:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394996.097830:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:0.0:1787394996.097848:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497152 00000100:00100000:0.0:1787394996.097851:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497152 00000100:00100000:0.0:1787394996.097875:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497280 00000100:00100000:0.0:1787394996.097878:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497280 00000100:00100000:0.0:1787394996.097896:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:0.0:1787394996.097902:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394996.097927:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394996.097933:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:0.0:1787394996.097952:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:0.0:1787394996.097958:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787394996.098005:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304497280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394996.098010:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00080000:0.0:1787394996.098025:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787394996.098028:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787394996.098031:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787394996.098388:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304496768 00000100:00100000:3.0:1787394996.098394:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304496768 00000100:00100000:3.0:1787394996.098470:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:3.0:1787394996.098478:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304496768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787394996.098521:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304496768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 43us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394996.098527:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 218 00010000:00010000:0.0:1787394996.691233:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787394997.718116:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787394997.847346:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323401728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787394997.847428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394997.847771:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401728 00000100:00100000:1.0:1787394997.847779:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401728 00000100:00100000:1.0:1787394997.847845:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787394997.847855:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323401728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787394997.847889:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787394997.848024:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787394997.848090:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323401728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 237us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394997.848099:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787394997.848155:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633dc00 x1874219323401728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787394997.848174:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323401728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787394998.360072:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323401984:0@lo:400:kworker.0 00000100:00100000:0.0:1787394998.360079:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323401856:0@lo:400:kworker.0 00000100:00100000:3.0:1787394998.360713:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323402240:0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.360914:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787394998.360914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394998.360973:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401856 00000100:00100000:1.0:1787394998.360981:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401856 00000100:00100000:1.0:1787394998.361038:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787394998.361056:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323401856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394998.361125:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323401856:12345-0@lo:400:kworker.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394998.361152:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787394998.361191:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323401984 00000100:00100000:1.0:1787394998.361195:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323401984 00000100:00100000:1.0:1787394998.361247:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787394998.361254:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323401984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787394998.361328:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323401984:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394998.361354:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787394998.361628:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323401856:0@lo:400:kworker.0 00000100:00100000:0.0:1787394998.361644:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323402368:0@lo:400:kworker.0 00000100:00100000:0.0:1787394998.361677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394998.361860:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323401984:0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.361869:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323402496:0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.361897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394998.361924:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394998.361930:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323402112:0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.361951:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394998.361975:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402368 00000100:00100000:2.0:1787394998.361979:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402368 00000100:00100000:2.0:1787394998.362010:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402112 00000100:00100000:2.0:1787394998.362013:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402112 00000100:00100000:2.0:1787394998.362030:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787394998.362035:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323402368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.362071:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323402368:12345-0@lo:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394998.362077:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787394998.362089:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787394998.362094:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323402112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787394998.362120:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323402112:12345-0@lo:400:kworker.0 Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787394998.362125:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1787394998.362139:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787394998.362157:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323402112:0@lo:400:kworker.0 00000100:00100000:0.0:1787394998.362243:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402496 00000100:00100000:0.0:1787394998.362247:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402496 00000100:00100000:0.0:1787394998.362295:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787394998.362301:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323402496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787394998.362378:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323402496:12345-0@lo:400:kworker.0 Request processed in 70us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787394998.362385:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787394998.362411:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787394998.362427:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323402368:0@lo:400:kworker.0 00010000:00080000:0.0:1787394998.362458:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33f443480 x1874219323402496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394998.362490:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323402496:0@lo:400:kworker.0 00000100:00100000:3.0:1787394998.366718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787394998.371404:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402240 00000100:00100000:2.0:1787394998.371420:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402240 00000100:00100000:3.0:1787394998.374412:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787394998.374426:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323402240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787394998.374524:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323402240:12345-0@lo:400:kworker.0 Request processed in 102us (7817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787394998.374531:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787394998.374702:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33f441180 x1874219323402240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787394998.374719:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323402240:0@lo:400:kworker.0 00010000:00010000:2.0:1787394998.738800:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787394998.868584:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787394998.868607:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323402624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787394998.868674:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787394998.869121:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402624 00000100:00100000:1.0:1787394998.869131:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402624 00000100:00100000:1.0:1787394998.869183:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787394998.869193:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323402624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787394998.869225:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787394998.869629:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323402624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 436us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787394998.869637:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1787394998.869759:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336224380 x1874219323402624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787394998.869837:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323402624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787394999.775475:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395000.787715:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395001.226716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395001.226810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395001.226840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395001.226862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395001.226886:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395001.226911:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497920 00000100:00100000:0.0:1787395001.226919:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497920 00000100:00100000:0.0:1787395001.226978:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497792 00000100:00100000:0.0:1787395001.226981:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497792 00000100:00100000:0.0:1787395001.227003:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:0.0:1787395001.227012:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395001.227084:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395001.227092:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:0.0:1787395001.227110:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:0.0:1787395001.227117:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395001.227140:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395001.227147:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00080000:0.0:1787395001.227179:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787395001.227183:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395001.227331:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497664 00000100:00100000:0.0:1787395001.227335:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497664 00000100:00100000:0.0:1787395001.227365:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497536 00000100:00100000:0.0:1787395001.227367:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497536 00000100:00100000:0.0:1787395001.227398:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:0.0:1787395001.227405:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395001.227438:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304497664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395001.227445:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:0.0:1787395001.227457:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:0.0:1787395001.227463:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304497536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395001.227486:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304497536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395001.227502:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00080000:0.0:1787395001.229850:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395001.232175:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304497408 00000100:00100000:1.0:1787395001.232187:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304497408 00000100:00100000:0.0:1787395001.234860:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00100000:0.0:1787395001.234872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304497408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395001.234967:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304497408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 96us (8261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395001.234975:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 220 00010000:00010000:0.0:1787395001.810653:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395002.834570:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395002.975083:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323402752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395002.975168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395002.975252:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402752 00000100:00100000:0.0:1787395002.975260:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402752 00000100:00100000:0.0:1787395002.975325:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787395002.975335:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323402752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395002.975367:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395002.975409:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323402752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395002.975417:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787395002.975435:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787395002.975463:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633d500 x1874219323402752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395002.975480:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323402752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395003.477559:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323402880:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395003.477663:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323403392:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395003.477707:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323402880 00000100:00100000:2.0:1787395003.477713:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787395003.477714:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323402880 00000100:00100000:2.0:1787395003.477718:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323403264:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395003.477766:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787395003.477775:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323402880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477780:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323403008:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395003.477816:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323403520:0@lo:400:kworker.0 00000100:00100000:1.0:1787395003.477828:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323402880:12345-0@lo:400:kworker.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.477836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395003.477836:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787395003.477850:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787395003.477855:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323403136:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.477874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395003.477898:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403392 00000100:00100000:2.0:1787395003.477902:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403392 00000100:00100000:2.0:1787395003.477935:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403008 00000100:00100000:2.0:1787395003.477938:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403008 00000100:00100000:2.0:1787395003.477949:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403136 00000100:00100000:2.0:1787395003.477962:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403136 00000100:00100000:2.0:1787395003.477981:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787395003.477987:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323403392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478019:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323403392:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.478025:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787395003.478032:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323402880:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478037:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787395003.478042:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323403008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395003.478044:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323403392:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478069:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323403008:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.478075:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787395003.478086:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787395003.478091:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323403136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478115:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323403136:12345-0@lo:400:kworker.0 Request processed in 24us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.478120:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787395003.478137:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403264 00000100:00100000:2.0:1787395003.478140:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403264 00000100:00100000:2.0:1787395003.478168:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403520 00000100:00100000:2.0:1787395003.478171:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403520 00000100:00100000:2.0:1787395003.478192:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787395003.478198:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323403264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478242:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323403264:12345-0@lo:400:kworker.0 Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.478248:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787395003.478259:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787395003.478264:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323403520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478297:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323403520:12345-0@lo:400:kworker.0 Request processed in 33us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395003.478302:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1787395003.478338:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787395003.478339:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33f440e00 x1874219323403264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787395003.478342:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395003.478361:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323403136:0@lo:400:kworker.0 00000100:00100000:2.0:1787395003.478369:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323403008:0@lo:400:kworker.0 00010000:00080000:2.0:1787395003.478377:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33f441180 x1874219323403520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395003.478385:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323403520:0@lo:400:kworker.0 00000100:00100000:1.0:1787395003.478414:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323403264:0@lo:400:kworker.0 00010000:00010000:0.0:1787395003.860210:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395003.993271:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323403648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395003.993398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395003.993508:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403648 00000100:00100000:0.0:1787395003.993517:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403648 00000100:00100000:0.0:1787395003.993595:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787395003.993607:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323403648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395003.993654:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395003.993703:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323403648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395003.993710:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1787395003.993777:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633d500 x1874219323403648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395003.993798:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323403648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787395004.887284:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395005.907503:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395006.337783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395006.337829:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395006.337860:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395006.337890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395006.337933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395006.337962:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498304 00000100:00100000:0.0:1787395006.337971:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498304 00000100:00100000:0.0:1787395006.338027:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498176 00000100:00100000:0.0:1787395006.338030:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498176 00000100:00100000:0.0:1787395006.338053:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:0.0:1787395006.338063:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498304:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395006.338141:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498304:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395006.338148:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:0.0:1787395006.338165:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:0.0:1787395006.338171:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304498176:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395006.338196:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304498176:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395006.338202:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:0.0:1787395006.338220:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498560 00000100:00100000:0.0:1787395006.338223:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498560 00000100:00100000:0.0:1787395006.338255:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498432 00000100:00100000:0.0:1787395006.338258:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498432 00000100:00100000:0.0:1787395006.338275:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:0.0:1787395006.338281:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498560:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395006.338335:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498560:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395006.338353:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:0.0:1787395006.338365:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:0.0:1787395006.338371:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498432:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395006.338398:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304498432:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395006.338403:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00080000:0.0:1787395006.338419:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787395006.338424:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395006.338426:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395006.338626:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498048 00000100:00100000:1.0:1787395006.338637:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498048 00000100:00100000:1.0:1787395006.338668:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 222 00000100:00100000:1.0:1787395006.338675:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304498048:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395006.338703:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304498048:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395006.338709:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 222 00010000:00010000:0.0:1787395006.930542:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395007.956154:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395008.083756:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323403776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395008.083825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395008.083959:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403776 00000100:00100000:0.0:1787395008.083968:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403776 00000100:00100000:0.0:1787395008.084016:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787395008.084026:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323403776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395008.084070:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787395008.084943:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395008.088585:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323403776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4551us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395008.088599:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787395008.092839:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c88000 x1874219323403776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395008.092869:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323403776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395008.596288:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323404288:0@lo:400:kworker.0 00000100:00100000:1.0:1787395008.596391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395008.596589:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787395008.596597:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323403904:0@lo:400:kworker.0 00000100:00100000:1.0:1787395008.596629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395008.596652:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323404416:0@lo:400:kworker.0 00000100:00100000:1.0:1787395008.596677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395008.596863:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323403904 00000100:00100000:1.0:1787395008.596872:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323403904 00000100:00100000:1.0:1787395008.596919:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787395008.596927:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323403904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395008.596978:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323403904:12345-0@lo:400:kworker.0 Request processed in 51us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395008.596985:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787395008.597332:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323403904:0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.597817:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323404032:0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.597857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395008.597891:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395008.597898:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323404160:0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.597924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395008.597954:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404288 00000100:00100000:0.0:1787395008.597959:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404288 00000100:00100000:0.0:1787395008.598007:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404032 00000100:00100000:0.0:1787395008.598020:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404032 00000100:00100000:0.0:1787395008.598036:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404160 00000100:00100000:0.0:1787395008.598038:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404160 00000100:00100000:0.0:1787395008.598135:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787395008.598143:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323404288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598193:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323404288:12345-0@lo:400:kworker.0 Request processed in 50us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395008.598200:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787395008.598217:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787395008.598223:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598256:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323404032:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395008.598262:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787395008.598274:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787395008.598279:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323404160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598357:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323404160:12345-0@lo:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395008.598363:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787395008.598382:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404416 00000100:00100000:0.0:1787395008.598386:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404416 00000100:00100000:0.0:1787395008.598413:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787395008.598420:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323404416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598572:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323404416:12345-0@lo:400:kworker.0 Request processed in 152us (1893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395008.598579:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787395008.598627:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323404160:0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598645:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323404032:0@lo:400:kworker.0 00010000:00080000:0.0:1787395008.598672:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33f441180 x1874219323404416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395008.598682:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323404416:0@lo:400:kworker.0 00000100:00100000:0.0:1787395008.598691:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323404288:0@lo:400:kworker.0 00000100:00080000:0.0:1787395008.599025:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395008.599030:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787395008.979431:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395009.107248:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323404544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395009.107341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395009.107569:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404544 00000100:00100000:3.0:1787395009.107577:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404544 00000100:00100000:3.0:1787395009.107630:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787395009.107639:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323404544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787395009.107683:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395009.109021:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323404544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1377us (1674us total) trans 0 rc 0/0 00010000:00080000:2.0:1787395009.109022:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633fb80 x1874219323404544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395009.109032:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787395009.109043:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323404544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787395010.005133:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395011.026637:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395011.468425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395011.468499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395011.468530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395011.468661:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498944 00000100:00100000:3.0:1787395011.468670:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498944 00000100:00100000:1.0:1787395011.468723:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498688 00000100:00100000:1.0:1787395011.468727:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498688 00000100:00100000:3.0:1787395011.468737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304498816 00000100:00100000:3.0:1787395011.468740:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304498816 00000100:00100000:3.0:1787395011.468757:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:1.0:1787395011.468757:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:3.0:1787395011.468766:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304498944:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395011.468766:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304498688:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395011.468828:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304498688:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 63us (418us total) trans 0 rc 0/0 00000100:00080000:2.0:1787395011.468836:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395011.468836:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:1.0:1787395011.468873:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:1.0:1787395011.468881:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304498816:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395011.469067:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304498944:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 169us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395011.469075:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:1.0:1787395011.469160:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304498816:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 279us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395011.469167:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:1.0:1787395011.471290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395011.471518:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395011.486908:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499072 00000100:00100000:2.0:1787395011.486923:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499072 00000100:00100000:3.0:1787395011.487502:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499200 00000100:00100000:3.0:1787395011.487508:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499200 00000100:00080000:3.0:1787395011.487801:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395011.488574:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395011.489261:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:0.0:1787395011.489276:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2362:x1874219304499200:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1787395011.489341:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a803e 00000100:00080000:0.0:1787395011.489351:0:6601:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787395011.489392:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787395011.489770:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:907adeaf-e431-466d-a504-1dc9d988b548+2:2362:x1874219304499200:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 498us (18250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395011.489779:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:0.0:1787395011.489796:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787395011.489804:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2362:x1874219304499072:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1787395011.489818:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a8037 00000100:00080000:0.0:1787395011.489825:0:6601:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787395011.489857:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787395011.490067:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:907adeaf-e431-466d-a504-1dc9d988b548+2:2362:x1874219304499072:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 263us (18783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395011.490074:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:3.0:1787395011.490277:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395011.493367:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787395011.673102:0:10873:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787395012.052664:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395013.075244:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395013.210827:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787395013.210851:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323404672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395013.210919:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395013.212972:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404672 00000100:00100000:3.0:1787395013.212984:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404672 00000100:00100000:3.0:1787395013.213141:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787395013.213151:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323404672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787395013.213185:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395013.213250:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323404672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395013.213264:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787395013.213330:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae5180 x1874219323404672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395013.213347:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323404672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787395013.213765:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1787395013.312233:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00000020:00000080:3.0:1787395013.312242:0:6626:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4c000/907adeaf-e431-466d-a504-1dc9d988b548 00000020:00000080:1.0:1787395013.312273:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4c000/907adeaf-e431-466d-a504-1dc9d988b548 for lustre-OST0000 00000020:00000080:1.0:1787395013.312841:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fb4f000 for lustre-OST0000 00000100:00100000:1.0:1787395013.721679:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323404800:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.721752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395013.721859:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404800 00000100:00100000:3.0:1787395013.721868:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404800 00000100:00100000:3.0:1787395013.721919:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787395013.721924:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323405056:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.721953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395013.721974:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395013.721980:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323405184:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722000:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395013.722044:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405056 00000100:00100000:1.0:1787395013.722048:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405056 00000100:00100000:1.0:1787395013.722094:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405184 00000100:00100000:1.0:1787395013.722098:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405184 00000100:00100000:1.0:1787395013.722118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787395013.722124:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323405056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395013.722256:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323404800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722282:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323405056:12345-0@lo:400:kworker.0 Request processed in 45us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395013.722295:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787395013.722296:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323404800:12345-0@lo:400:kworker.0 Request processed in 366us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395013.722334:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787395013.722339:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787395013.722348:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323405184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722380:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323405184:12345-0@lo:400:kworker.0 Request processed in 35us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395013.722386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1787395013.722406:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395013.722434:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323405184:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722443:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323405056:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722476:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323405312:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395013.722622:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323404800:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722632:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787395013.722637:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323404928:0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395013.722680:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323404928 00000100:00100000:1.0:1787395013.722683:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323404928 00000100:00100000:1.0:1787395013.722704:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787395013.722718:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323404928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395013.722750:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323404928:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395013.722757:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787395013.722782:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323404928:0@lo:400:kworker.0 00000100:00100000:3.0:1787395013.722916:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405312 00000100:00100000:3.0:1787395013.722922:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405312 00000100:00100000:3.0:1787395013.723188:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787395013.723198:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323405312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395013.723243:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323405312:12345-0@lo:400:kworker.0 Request processed in 47us (645us total) trans 0 rc 0/0 00010000:00080000:0.0:1787395013.723298:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336227100 x1874219323405312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395013.723336:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323405312:0@lo:400:kworker.0 00000100:00100000:3.0:1787395013.725029:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787395013.725234:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787395013.766038:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00000020:00000080:1.0:1787395013.766048:0:7503:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4e000/907adeaf-e431-466d-a504-1dc9d988b548 00000020:00000080:0.0:1787395013.766111:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4e000/907adeaf-e431-466d-a504-1dc9d988b548 for lustre-OST0001 00000020:00000080:0.0:1787395013.766268:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fb4b000 for lustre-OST0001 00010000:00010000:3.0:1787395014.100401:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395014.229012:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787395014.229035:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323405440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395014.229099:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395014.229161:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405440 00000100:00100000:0.0:1787395014.229169:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405440 00000100:00100000:0.0:1787395014.229209:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787395014.229218:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323405440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395014.229251:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395014.229323:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323405440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395014.229331:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787395014.229366:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633ea00 x1874219323405440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395014.229383:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323405440:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787395015.129589:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787395015.301817:0:11023:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffc8657fd0 00000020:00000080:1.0:1787395015.301834:0:11023:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787395015.301839:0:11023:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787395015.301847:0:11023:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc865a260 20000000:00000080:1.0:1787395015.301854:0:11023:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b33a3f1c00 uarg=0000000000000000 20000000:01000000:1.0:1787395015.301892:0:11023:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787395015.301898:0:11023:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787395015.301903:0:11023:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787395015.305010:0:11024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787395015.305187:0:11023:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787395015.315697:0:11023:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787395015.315934:0:11023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315953:0:11023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315962:0:11023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315978:0:11023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315986:0:11023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315993:0:11023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.315999:0:11023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316046:0:11023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316060:0:11023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 12 pid: 5795 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.316074:0:11023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405568:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395015.316216:0:11023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316225:0:11023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 12 pid: 5797 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.316234:0:11023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405696:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395015.316266:0:11023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316298:0:11023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 18 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.316335:0:11023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405824:0@lo:104: 00000100:00100000:0.0:1787395015.316377:0:11023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787395015.316431:0:11023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316439:0:11023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 18 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.316458:0:11023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405952:0@lo:104: 00000100:00100000:0.0:1787395015.316484:0:11023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787395015.316509:0:11023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395015.316517:0:11023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 18 pid: 5796 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.316525:0:11023:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323406080:0@lo:104: 00000100:00100000:0.0:1787395015.316543:0:11023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395015.316554:0:11023:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395015.316654:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405824 00000100:00100000:1.0:1787395015.316661:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405824 00000100:00100000:1.0:1787395015.316696:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323405952 00000100:00100000:1.0:1787395015.316699:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323405952 00000100:00100000:1.0:1787395015.316709:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406080 00000100:00100000:1.0:1787395015.316711:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406080 00000100:00100000:1.0:1787395015.316724:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787395015.316731:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:11023:x1874219323405824:12345-0@lo:104: 00010000:00010000:1.0:1787395015.316743:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.316801:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787395015.316808:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+5:11023:x1874219323405824:12345-0@lo:104: Request processed in 77us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395015.316815:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787395015.316834:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787395015.316840:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:11023:x1874219323405952:12345-0@lo:104: 00010000:00010000:1.0:1787395015.316847:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.316879:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787395015.316884:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:11023:x1874219323405952:12345-0@lo:104: Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395015.316889:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787395015.316901:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787395015.316907:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11023:x1874219323406080:12345-0@lo:104: 00010000:00010000:1.0:1787395015.316914:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.316944:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787395015.316948:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11023:x1874219323406080:12345-0@lo:104: Request processed in 43us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395015.316953:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787395015.316969:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787395015.316974:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.316980:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395015.316990:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.316997:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395015.317003:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395015.317008:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787395015.317031:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317036:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787395015.317053:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317060:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b341011600/0xedbabbe2e89a8006 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a800d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317071:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787395015.317074:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317079:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166a00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395015.317083:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317089:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395015.317109:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395015.317116:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787395015.317130:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317136:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787395015.317142:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317148:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342166a00/0xedbabbe2e89a7ff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7fff expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317158:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395015.317160:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317165:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395015.317168:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317174:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395015.317180:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395015.317185:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787395015.317204:0:7492:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317210:0:7492:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787395015.317223:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317229:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a7fea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a7ff1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395015.317241:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395015.317243:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395015.317244:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395015.317256:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323406208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395015.317287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395015.318756:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323406464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787395015.318809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787395015.318932:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395015.318939:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395015.320869:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406208 00000100:00100000:2.0:1787395015.320882:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406208 00010000:00010000:2.0:1787395015.320921:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 19 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.320951:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406464 00000100:00100000:2.0:1787395015.320953:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406464 00010000:00010000:2.0:1787395015.320961:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 20 pid: 5796 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.320973:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787395015.320979:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3303:x1874219323406208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395015.320991:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395015.320996:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 20 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.321006:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 20 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.321025:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395015.321081:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3303:x1874219323406208:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395015.321089:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787395015.321131:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787395015.321137:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323406464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395015.321144:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395015.321148:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 19 pid: 5796 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.321173:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 19 pid: 5796 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.321183:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395015.321208:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323406464:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395015.321214:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787395015.323989:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395015.324017:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395015.324037:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499456 00000100:00100000:2.0:1787395015.324044:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499456 00010000:00010000:2.0:1787395015.324074:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 13 pid: 5797 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.324092:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499328 00000100:00100000:2.0:1787395015.324094:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499328 00010000:00010000:2.0:1787395015.324102:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 14 pid: 5795 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.324112:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395015.324118:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+14:2364:x1874219304499456:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395015.324130:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395015.324135:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 14 pid: 5797 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.324146:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 14 pid: 5797 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.324185:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395015.324240:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+14:2364:x1874219304499456:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395015.324249:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395015.324265:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:2.0:1787395015.324270:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304499328:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395015.324277:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395015.324285:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 13 pid: 5795 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.324294:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 13 pid: 5795 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.324303:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395015.324334:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304499328:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395015.324340:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:1.0:1787395015.326846:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323406208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395015.326877:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395015.326887:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323406336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395015.326947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395015.327265:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323406464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395015.327337:0:11023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341010a00/0xedbabbe2e89a8029 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc213c expref: 12 pid: 5795 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.327372:0:11023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405568:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395015.327387:0:11023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a8014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2104 expref: 11 pid: 5797 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.327396:0:11023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405696:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395015.327421:0:11023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a800d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a8006 expref: 18 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.327429:0:11023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405824:0@lo:104: 00000100:00100000:0.0:1787395015.327439:0:11023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323405952:0@lo:104: 00010000:00010000:0.0:1787395015.327457:0:11023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48200/0xedbabbe2e89a7ff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7fea expref: 17 pid: 5796 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395015.327465:0:11023:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11023:1874219323406080:0@lo:104: 00010000:00010000:0.0:1787395015.327490:0:11023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.328962:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406336 00000100:00100000:2.0:1787395015.328973:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406336 00010000:00010000:2.0:1787395015.329022:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 17 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.329062:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787395015.329071:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:3303:x1874219323406336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395015.329085:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395015.329090:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 17 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329112:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 17 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329130:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167800/0xedbabbe2e89a7fff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a7ff8 expref: 17 pid: 5797 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329144:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329152:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329168:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329174:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329181:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329188:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329195:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395015.329199:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329207:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329232:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395015.329242:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395015.329253:0:11023:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395015.329268:0:11023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395015.329273:0:11023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a8045 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395015.329320:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3303:x1874219323406336:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395015.329327:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787395015.332901:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323406336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395016.146653:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395016.577455:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395016.577504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395016.577530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395016.577570:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499584 00000100:00100000:3.0:1787395016.577580:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499584 00000100:00100000:3.0:1787395016.577627:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 226 00000100:00100000:3.0:1787395016.577637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2366:x1874219304499584:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395016.584664:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499840 00000100:00100000:0.0:1787395016.584736:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499840 00000100:00100000:0.0:1787395016.584810:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499712 00000100:00100000:0.0:1787395016.584813:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499712 00000100:00100000:0.0:1787395016.584843:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:0.0:1787395016.584920:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304499840:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395016.588680:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:2.0:1787395016.588704:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304499712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395016.588845:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2366:x1874219304499584:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 11207us (11406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395016.588856:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 226 00000100:00100000:0.0:1787395016.590664:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304499840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 5803us (13149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395016.590697:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00080000:0.0:1787395016.590737:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395016.592403:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304499712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3695us (14855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395016.592417:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 10000000:01000000:0.0:1787395017.108089:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787395017.108097:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f645800 from 7 10000000:01000000:0.0:1787395017.108102:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787395017.108155:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395017.108167:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395017.108178:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395017.108203:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787395017.108267:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395017.108337:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b303fb86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.108960:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406592 00000100:00100000:3.0:1787395017.127570:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406592 00000100:00100000:3.0:1787395017.127643:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787395017.127652:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323406592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395017.127677:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395017.127698:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a804c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.127725:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.127737:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.127754:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395017.127835:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (19568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.127842:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1787395017.127908:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395017.127926:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.127936:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395017.128005:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.128037:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395017.128064:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.128078:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406720 00000100:00100000:3.0:1787395017.128081:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406720 00000100:00100000:3.0:1787395017.128103:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787395017.128109:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.128362:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.128369:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787395017.128402:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.128440:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.128481:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395017.128499:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.128510:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406848 00000100:00100000:3.0:1787395017.128513:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406848 00000100:00100000:3.0:1787395017.128533:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787395017.128539:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.128672:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.128679:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787395017.128714:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787395017.129300:0:11079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787395017.129369:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787395017.129384:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787395017.129391:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129401:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395017.129411:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787395017.129414:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b305de9800 from 7 10000000:01000000:3.0:1787395017.129417:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787395017.129449:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129457:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129464:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395017.129491:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.129525:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395017.129541:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.129555:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323406976 00000100:00100000:3.0:1787395017.129559:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323406976 00000100:00100000:3.0:1787395017.129583:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787395017.129589:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323406976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395017.129598:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395017.129608:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a805a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129627:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129637:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129644:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c400, rc 0) 00000100:00100000:3.0:1787395017.129671:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323406976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.129677:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787395017.129711:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323406976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395017.129722:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.129729:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395017.129773:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.129799:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395017.129811:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.129821:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407104 00000100:00100000:3.0:1787395017.129823:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407104 00000100:00100000:3.0:1787395017.129842:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787395017.129848:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323407104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.130018:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323407104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.130026:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787395017.130054:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.130076:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.130110:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395017.130123:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.130133:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407232 00000100:00100000:3.0:1787395017.130136:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407232 00000100:00100000:3.0:1787395017.130154:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787395017.130159:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323407232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.130267:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323407232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.130274:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787395017.130332:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787395017.131291:0:11080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787395017.131367:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787395017.131380:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787395017.131399:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.131409:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395017.131419:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787395017.131437:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b318a89000 from 7 10000000:01000000:1.0:1787395017.131440:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787395017.131464:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.131472:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.131481:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395017.131497:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.131534:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395017.131558:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787395017.133960:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407360 00000100:00100000:3.0:1787395017.134074:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407360 00000100:00100000:3.0:1787395017.134130:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787395017.134139:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323407360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395017.134152:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395017.134169:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a8068 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.134193:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.134203:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395017.134212:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d600, rc 0) 00000100:00100000:3.0:1787395017.134329:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323407360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.134336:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787395017.147841:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395017.147876:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.147888:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395017.147982:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.148041:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395017.148085:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395017.148187:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407488 00000100:00100000:0.0:1787395017.148194:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407488 00000100:00100000:0.0:1787395017.148242:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787395017.148251:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323407488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395017.148544:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323407488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395017.148553:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787395017.149534:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.149586:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.149652:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395017.149686:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308cc8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395017.150796:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407616 00000100:00100000:0.0:1787395017.150809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407616 00000100:00100000:0.0:1787395017.150864:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787395017.150872:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323407616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787395017.151094:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323407616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395017.151103:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787395017.154851:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323407616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787395017.158848:0:11081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787395017.159183:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787395017.159203:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787395017.159213:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395017.159226:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395017.169942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395017.170060:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304499968 00000100:00100000:1.0:1787395017.170070:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304499968 00000100:00100000:1.0:1787395017.170139:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 236 00000100:00100000:1.0:1787395017.170150:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:5579:x1874219304499968:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395017.170165:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395017.170183:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2166 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.170208:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.170218:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395017.170228:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030a00, rc 0) 00000100:00100000:1.0:1787395017.170303:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304499968:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 155us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395017.170372:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 236 00010000:00010000:3.0:1787395017.170564:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395017.174941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395017.175084:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500096 00000100:00100000:3.0:1787395017.175094:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500096 00000100:00100000:3.0:1787395017.175187:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:3.0:1787395017.175197:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304500096:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395017.175536:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304500096:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 339us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395017.175545:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:2.0:1787395017.178611:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395017.178751:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500224 00000100:00100000:1.0:1787395017.178760:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500224 00000100:00100000:1.0:1787395017.178841:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:1.0:1787395017.178851:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304500224:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.179148:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304500224:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 297us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395017.179156:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:3.0:1787395017.183058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395017.183946:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500352 00000100:00100000:2.0:1787395017.183959:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500352 00000100:00100000:2.0:1787395017.184018:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 239 00000100:00100000:2.0:1787395017.184027:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304500352:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395017.184043:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395017.184061:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc216d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395017.184108:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395017.184117:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395017.184126:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48400, rc 0) 00000100:00100000:2.0:1787395017.184178:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304500352:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 153us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395017.184185:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 239 00000100:00100000:2.0:1787395017.186940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395017.187044:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500480 00000100:00100000:2.0:1787395017.187053:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500480 00000100:00100000:2.0:1787395017.187100:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 240 00000100:00100000:2.0:1787395017.187108:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304500480:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787395017.187666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304500480:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 555us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395017.187779:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 240 00000100:00100000:2.0:1787395017.190852:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395017.190913:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500608 00000100:00100000:1.0:1787395017.190921:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500608 00000100:00100000:1.0:1787395017.190974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 241 00000100:00100000:1.0:1787395017.190983:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304500608:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395017.191184:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304500608:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 200us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395017.191191:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 241 00010000:00010000:3.0:1787395018.194437:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395018.325248:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787395018.325270:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323407744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395018.325353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395018.325431:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407744 00000100:00100000:2.0:1787395018.325438:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407744 00000100:00100000:2.0:1787395018.325489:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787395018.325498:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323407744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395018.325545:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395018.325589:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323407744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395018.325597:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787395018.325617:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787395018.325646:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae6d80 x1874219323407744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395018.325663:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323407744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395018.841427:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323408000:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.841508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395018.841573:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787395018.841580:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323407872:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.841608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395018.841629:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323408384:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.841654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395018.841679:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323408128:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.841700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395018.841717:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787395018.841722:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323408256:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.841745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395018.841854:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408000 00000100:00100000:3.0:1787395018.841862:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408000 00000100:00100000:3.0:1787395018.841904:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408128 00000100:00100000:3.0:1787395018.841907:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408128 00000100:00100000:3.0:1787395018.841928:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408256 00000100:00100000:3.0:1787395018.841932:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408256 00000100:00100000:3.0:1787395018.841946:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787395018.841954:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323408000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.842006:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323408000:12345-0@lo:400:kworker.0 Request processed in 52us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395018.842012:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787395018.842029:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787395018.842036:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323408128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.842069:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323408128:12345-0@lo:400:kworker.0 Request processed in 33us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395018.842075:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787395018.842095:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787395018.842100:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323408256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.842127:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323408256:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395018.842132:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787395018.842865:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323407872 00000100:00100000:3.0:1787395018.842872:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323407872 00000100:00100000:3.0:1787395018.842912:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787395018.842919:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323407872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.842959:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323407872:12345-0@lo:400:kworker.0 Request processed in 41us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395018.842965:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787395018.842997:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408384 00000100:00100000:3.0:1787395018.843001:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408384 00000100:00100000:3.0:1787395018.843034:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787395018.843040:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3390d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323408384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.843072:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3390d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323408384:12345-0@lo:400:kworker.0 Request processed in 33us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395018.843078:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787395018.843709:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395018.843715:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395018.843750:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323408256:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.844221:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323408128:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.845221:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323407872:0@lo:400:kworker.0 00010000:00080000:3.0:1787395018.845248:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c8a300 x1874219323408384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395018.845463:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323408384:0@lo:400:kworker.0 00000100:00100000:3.0:1787395018.845482:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323408000:0@lo:400:kworker.0 00010000:00010000:0.0:1787395019.235510:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395019.352076:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323408512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395019.352142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395019.352332:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408512 00000100:00100000:0.0:1787395019.352339:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408512 00000100:00100000:0.0:1787395019.352392:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787395019.352401:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323408512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395019.352443:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395019.352487:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323408512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395019.352495:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787395019.352532:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3396b2a00 x1874219323408512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395019.352551:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323408512:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787395019.641385:0:11221:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787395020.247437:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395021.267214:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395021.696836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395021.696889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395021.696919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395021.696923:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500736 00000100:00100000:0.0:1787395021.696934:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500736 00000100:00100000:3.0:1787395021.696944:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500992 00000100:00100000:3.0:1787395021.696950:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500992 00000100:00100000:3.0:1787395021.696997:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304500864 00000100:00100000:0.0:1787395021.696999:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 243 00000100:00100000:3.0:1787395021.697001:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304500864 00000100:00100000:0.0:1787395021.697013:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304500736:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395021.697029:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:3.0:1787395021.697039:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304500992:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395021.697108:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304500736:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395021.697116:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 243 00000100:00100000:3.0:1787395021.698873:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304500992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1825us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395021.698887:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:3.0:1787395021.698920:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:3.0:1787395021.698933:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304500864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395021.698982:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304500864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 54us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395021.698989:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00080000:3.0:1787395021.699029:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787395022.290703:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787395023.261606:0:11321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:37:02 (1787395022) === 00010000:00010000:3.0:1787395023.315765:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395023.414369:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.414426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.414452:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304501120 00000100:00100000:3.0:1787395023.414462:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304501120 00000100:00100000:3.0:1787395023.414515:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787395023.414524:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304501120:12345-192.168.203.16@tcp:41:mkdir.0 00000004:00000024:3.0:1787395023.414566:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787395023.414633:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304501120:12345-192.168.203.16@tcp:41:mkdir.0 Request processed in 110us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.414640:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00080000:3.0:1787395023.414660:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395023.419008:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304501248 00000100:00100000:1.0:1787395023.419023:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304501248 00000100:00100000:1.0:1787395023.423537:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787395023.423557:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cada4208-c1d6-4319-a546-8bfc38316f45+6:9667:x1874219304501248:12345-192.168.203.16@tcp:700:mkdir.0 00000100:00100000:1.0:1787395023.423656:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:cada4208-c1d6-4319-a546-8bfc38316f45+6:9667:x1874219304501248:12345-192.168.203.16@tcp:700:mkdir.0 Request processed in 105us (9228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395023.423665:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787395023.431675:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395023.432084:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304501504 00000100:00100000:0.0:1787395023.432094:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304501504 00000100:00100000:0.0:1787395023.432165:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787395023.432176:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:9667:x1874219304501504:12345-192.168.203.16@tcp:36:mkdir.0 00010000:00010000:0.0:1787395023.432243:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395023.432339:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a7f65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20ef expref: 6 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432357:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318517000) 00010000:00010000:0.0:1787395023.432369:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395023.432690:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432705:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432716:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432746:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432755:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.432773:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395023.434050:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787395023.434063:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434073:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434080:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434086:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395023.434091:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434099:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434112:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946600) 00010000:00010000:0.0:1787395023.434115:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395023.434119:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.434125:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8084 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395023.434143:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5589231 reply state 000000006a066bda transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395023.434164:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395023.434272:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:9667:x1874219304501504:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 2094us (2603us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787395023.434281:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:0.0:1787395023.438897:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438915:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438923:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438930:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395023.438934:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438941:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438958:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0b318946a00) 00010000:00010000:0.0:1787395023.438961:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395023.438965:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.438972:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a808b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395023.444007:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323408640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395023.444076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395023.444145:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408640 00000100:00100000:1.0:1787395023.444166:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408640 00000100:00100000:1.0:1787395023.444216:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787395023.444224:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323408640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787395023.444255:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395023.444297:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323408640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395023.444329:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787395023.444350:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787395023.444378:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336227100 x1874219323408640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395023.444419:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323408640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395023.445895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.446111:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304501632 00000100:00100000:2.0:1787395023.446119:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304501632 00000100:00100000:2.0:1787395023.446173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:2.0:1787395023.446183:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:9668:x1874219304501632:12345-192.168.203.16@tcp:101:chmod.0 00010000:00010000:2.0:1787395023.446202:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395023.446227:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2174 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446288:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446303:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446347:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395023.446417:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787395023.446421:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395023.446472:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446574:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2174 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446591:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2174 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.446600:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7300) 00010000:00010000:2.0:1787395023.446603:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395023.446607:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49c00, rc 0) 00000100:00100000:2.0:1787395023.446660:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:9668:x1874219304501632:12345-192.168.203.16@tcp:101:chmod.0 Request processed in 478us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.446667:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:0.0:1787395023.456839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.458485:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304501888 00000100:00100000:3.0:1787395023.458496:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304501888 00000100:00100000:3.0:1787395023.458559:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787395023.458570:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:9668:x1874219304501888:12345-192.168.203.16@tcp:36:chmod.0 00010000:00010000:3.0:1787395023.458617:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395023.458642:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a8099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2174 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.458663:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7300) 00010000:00010000:3.0:1787395023.458675:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395023.458701:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.458783:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.458811:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395023.459103:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000921836c reply state 000000007b01afbc transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395023.459112:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787395023.459124:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787395023.459205:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:9668:x1874219304501888:12345-192.168.203.16@tcp:36:chmod.0 Request processed in 636us (2375us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787395023.459212:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00010000:00010000:3.0:1787395023.463669:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463687:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463695:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463700:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55de00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.463705:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463723:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463740:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3e00) 00010000:00010000:3.0:1787395023.463744:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787395023.463748:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.463768:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80a0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395023.479394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.479783:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304502016 00000100:00100000:2.0:1787395023.479793:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304502016 00000100:00100000:2.0:1787395023.479843:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:2.0:1787395023.479861:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:9669:x1874219304502016:12345-192.168.203.16@tcp:101:chown.0 00010000:00010000:2.0:1787395023.479882:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395023.479902:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc217b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.479964:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.479977:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.479988:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395023.480051:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787395023.480055:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395023.480091:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.480116:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc217b expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.480133:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc217b expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.480141:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7500) 00010000:00010000:2.0:1787395023.480144:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395023.480147:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49000, rc 0) 00000100:00100000:2.0:1787395023.480204:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:9669:x1874219304502016:12345-192.168.203.16@tcp:101:chown.0 Request processed in 345us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.480211:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:0.0:1787395023.487530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395023.487713:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304502144 00000100:00100000:1.0:1787395023.487723:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304502144 00000100:00100000:1.0:1787395023.487834:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787395023.487844:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:9669:x1874219304502144:12345-192.168.203.16@tcp:101:chown.0 00010000:00010000:1.0:1787395023.487865:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395023.487886:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a80b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2182 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.487951:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.487964:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.487976:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.487990:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.487996:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488003:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488115:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488136:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488144:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395023.488184:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787395023.488188:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395023.488212:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488224:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488231:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488238:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488244:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395023.488248:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488254:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488266:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7500) 00010000:00010000:1.0:1787395023.488269:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395023.488273:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488288:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a80bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488303:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488370:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488376:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488381:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395023.488384:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488399:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488408:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0b318517d00) 00010000:00010000:1.0:1787395023.488411:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395023.488414:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488421:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a80c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488460:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a80b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2182 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488473:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2182 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395023.488487:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b318517b00) 00010000:00010000:1.0:1787395023.488489:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787395023.488491:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030600, rc 0) 00000100:00100000:1.0:1787395023.488545:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:9669:x1874219304502144:12345-192.168.203.16@tcp:101:chown.0 Request processed in 703us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395023.488553:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:0.0:1787395023.496112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.496282:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304502400 00000100:00100000:2.0:1787395023.496293:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304502400 00000100:00100000:2.0:1787395023.496732:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:2.0:1787395023.496743:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:9669:x1874219304502400:12345-192.168.203.16@tcp:36:chown.0 00010000:00010000:2.0:1787395023.496796:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395023.496821:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a80ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2182 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.496840:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b318517b00) 00010000:00010000:2.0:1787395023.496852:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395023.496892:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.496903:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.496912:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395023.541474:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056f2d7e2 reply state 0000000069ff9a98 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395023.541494:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787395023.541661:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787395023.541772:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+10:9669:x1874219304502400:12345-192.168.203.16@tcp:36:chown.0 Request processed in 45026us (45664us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787395023.541782:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000001:00080000:0.0:1787395023.541934:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1787395023.541960:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1787395023.542140:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542149:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542157:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542163:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.542168:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542175:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542202:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:2.0:1787395023.542205:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787395023.542209:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.542215:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a80d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395023.577368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.578182:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304502528 00000100:00100000:3.0:1787395023.578194:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304502528 00000100:00100000:3.0:1787395023.578268:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:3.0:1787395023.578278:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:9670:x1874219304502528:12345-192.168.203.16@tcp:101:touch.500 00010000:00010000:3.0:1787395023.578303:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395023.578360:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2189 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395023.582558:0:6624:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4137us 00010000:00010000:3.0:1787395023.606562:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.606588:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.606599:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.606615:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.606623:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.606629:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.607943:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.607960:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.607969:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395023.608057:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787395023.608061:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395023.608152:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608166:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608172:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608177:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608183:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.608186:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608193:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608206:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7500) 00010000:00010000:3.0:1787395023.608217:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395023.608891:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608901:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c600/0xedbabbe2e89a80df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608914:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608920:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608925:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608930:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.608932:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608938:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608947:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0b308bf3e00) 00010000:00010000:3.0:1787395023.608949:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395023.608952:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608958:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a80e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.608995:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a80d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2189 expref: 8 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.609022:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2189 expref: 7 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.609029:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:3.0:1787395023.609032:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787395023.609034:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787395023.609141:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:9670:x1874219304502528:12345-192.168.203.16@tcp:101:touch.500 Request processed in 30863us (31781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.609149:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:0.0:1787395023.611780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.611865:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304502784 00000100:00100000:3.0:1787395023.611875:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304502784 00000100:00100000:3.0:1787395023.611964:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:3.0:1787395023.611975:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:9670:x1874219304502784:12345-192.168.203.16@tcp:101:touch.500 00010000:00010000:3.0:1787395023.611995:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395023.612015:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a80f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2190 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612570:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612585:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612595:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612610:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612626:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.612633:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395023.613808:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787395023.614080:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614094:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614103:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614137:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614145:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614152:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614158:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.614163:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614170:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614192:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:3.0:1787395023.614195:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395023.614199:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614205:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a80fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395023.614284:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd43ab17 reply state 000000002f609010 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395023.614295:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787395023.614553:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a80f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2190 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614566:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2190 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.614572:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b308bf3800) 00010000:00010000:3.0:1787395023.614574:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395023.614577:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55dc00, rc 0) 00000100:00100000:3.0:1787395023.614692:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+10:9670:x1874219304502784:12345-192.168.203.16@tcp:101:touch.500 Request processed in 2718us (2920us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787395023.614701:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:1.0:1787395023.618809:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395023.619259:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619273:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619281:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619287:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.619292:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619300:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619489:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffffa0b308bf3d00) 00010000:00010000:2.0:1787395023.619493:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395023.619497:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.619503:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8102 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395023.619683:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503040 00000100:00100000:0.0:1787395023.619693:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503040 00000100:00100000:0.0:1787395023.619782:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:0.0:1787395023.619793:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:9670:x1874219304503040:12345-192.168.203.16@tcp:36:touch.500 00010000:00010000:0.0:1787395023.619848:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395023.619865:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2190 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.619876:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b308bf3800) 00010000:00010000:0.0:1787395023.619882:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395023.619922:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.619933:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.619942:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395023.620069:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d4efe12b reply state 00000000f218f459 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395023.620079:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395023.620172:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+10:9670:x1874219304503040:12345-192.168.203.16@tcp:36:touch.500 Request processed in 381us (1372us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787395023.620187:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:1.0:1787395023.624720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.625135:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503168 00000100:00100000:2.0:1787395023.625146:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503168 00000100:00100000:2.0:1787395023.625208:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787395023.625219:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+10:9670:x1874219304503168:12345-192.168.203.16@tcp:101:touch.500 00010000:00010000:2.0:1787395023.625253:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395023.625274:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a811e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2197 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.625368:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a811e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2197 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.625382:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a811e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2197 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.625411:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b318946a00) 00010000:00010000:2.0:1787395023.625414:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787395023.625417:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395023.625471:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+11:9670:x1874219304503168:12345-192.168.203.16@tcp:101:touch.500 Request processed in 253us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.625478:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00010000:00010000:3.0:1787395023.625694:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625703:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625781:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625786:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.625789:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625795:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625803:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b318946a00) 00010000:00010000:3.0:1787395023.625805:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395023.625807:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.625811:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8117 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395023.630536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.630601:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503296 00000100:00100000:3.0:1787395023.630611:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503296 00000100:00100000:3.0:1787395023.630684:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787395023.630692:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304503296:12345-192.168.203.16@tcp:8:touch.500 00010000:00080000:3.0:1787395023.630726:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:3.0:1787395023.630758:0:6602:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a8125 00002000:00100000:3.0:1787395023.630770:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cada4208-c1d6-4319-a546-8bfc38316f45/ffffa0b20324c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787395023.630780:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787395023.631082:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787395023.631112:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa0b20324f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787395023.631199:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304503296:12345-192.168.203.16@tcp:8:touch.500 Request processed in 506us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.631207:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787395023.637984:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.638140:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503424 00000100:00100000:3.0:1787395023.638150:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503424 00000100:00100000:3.0:1787395023.638265:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787395023.638277:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:0:x1874219304503424:12345-192.168.203.16@tcp:2:touch.500 00000100:00080000:1.0:1787395023.638670:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787395023.688160:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787395023.688178:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000100:00100000:0.0:1787395023.689188:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:0:x1874219304503424:12345-192.168.203.16@tcp:2:touch.500 Request processed in 50905us (51206us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787395023.689201:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:0.0:1787395023.693645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.693746:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503680 00000100:00100000:2.0:1787395023.693756:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503680 00000100:00100000:2.0:1787395023.693807:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:2.0:1787395023.693816:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+10:9670:x1874219304503680:12345-192.168.203.16@tcp:35:touch.500 00000100:00100000:2.0:1787395023.694147:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+11:9670:x1874219304503680:12345-192.168.203.16@tcp:35:touch.500 Request processed in 331us (512us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787395023.694172:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:1.0:1787395023.708760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.708872:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304503808 00000100:00100000:3.0:1787395023.708881:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304503808 00000100:00100000:3.0:1787395023.708943:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:3.0:1787395023.708954:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+11:9671:x1874219304503808:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1787395023.708982:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395023.709001:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a812c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc219e expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709066:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709077:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709088:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395023.709145:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787395023.709148:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395023.709181:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709217:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a812c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc219e expref: 13 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709246:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc219e expref: 12 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.709255:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:3.0:1787395023.709258:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395023.709261:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395023.709578:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+12:9671:x1874219304503808:12345-192.168.203.16@tcp:101:rm.0 Request processed in 626us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.709586:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:1.0:1787395023.712205:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.712275:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504064 00000100:00100000:2.0:1787395023.712286:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504064 00000100:00100000:2.0:1787395023.712367:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:2.0:1787395023.712377:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:9671:x1874219304504064:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1787395023.712414:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395023.712433:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a813a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21a5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395023.712540:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787395023.712865:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a813a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21a5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.712880:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7500) 00010000:00010000:2.0:1787395023.712883:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395023.712888:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a813a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21a5 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.712902:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787395023.712960:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+13:9671:x1874219304504064:12345-192.168.203.16@tcp:101:rm.0 Request processed in 584us (761us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787395023.712968:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:0.0:1787395023.715214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.715265:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504192 00000100:00100000:2.0:1787395023.715275:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504192 00000100:00100000:2.0:1787395023.715375:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:2.0:1787395023.715398:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+13:9671:x1874219304504192:12345-192.168.203.16@tcp:37:rm.0 00000100:00100000:2.0:1787395023.719281:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+13:9671:x1874219304504192:12345-192.168.203.16@tcp:37:rm.0 Request processed in 3887us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.719297:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787395023.721976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395023.722040:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504448 00000100:00100000:3.0:1787395023.722050:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504448 00000100:00100000:3.0:1787395023.722105:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787395023.722114:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b310803c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+13:9671:x1874219304504448:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:3.0:1787395023.722397:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b310803c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:9671:x1874219304504448:12345-192.168.203.16@tcp:35:rm.0 Request processed in 273us (417us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787395023.722405:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1787395023.725591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395023.725690:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504704 00000100:00100000:1.0:1787395023.725701:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504704 00000100:00100000:2.0:1787395023.725786:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395023.725799:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+14:9671:x1874219304504704:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1787395023.725824:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395023.725903:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21ac expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.726021:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a814f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.726035:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a814f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.726048:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a814f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395023.726058:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787395023.726173:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ac expref: 17 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.726191:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a814f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ac expref: 16 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.726199:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:2.0:1787395023.726202:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395023.726205:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49c00, rc 0) 00000100:00100000:2.0:1787395023.726283:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304504704:12345-192.168.203.16@tcp:101:rm.0 Request processed in 487us (699us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787395023.726291:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:1.0:1787395023.731950:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395023.732051:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504832 00000100:00100000:0.0:1787395023.732060:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504832 00000100:00100000:0.0:1787395023.732122:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:0.0:1787395023.732133:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304504832:12345-192.168.203.16@tcp:41:rm.0 00000004:00000024:0.0:1787395023.732192:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787395023.734055:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304504832:12345-192.168.203.16@tcp:41:rm.0 Request processed in 1916us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395023.734068:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:1.0:1787395023.741701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395023.741857:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304504960 00000100:00100000:0.0:1787395023.741867:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304504960 00000100:00100000:0.0:1787395023.741922:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:0.0:1787395023.741931:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304504960:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:0.0:1787395023.741952:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395023.741972:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a815d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21b3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742038:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742071:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742081:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742096:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742102:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742109:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742274:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742282:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742288:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395023.742364:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787395023.742368:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395023.742393:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742405:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742423:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742429:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742436:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742451:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395023.742455:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742463:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742476:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:0.0:1787395023.742479:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395023.742483:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742489:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742505:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742510:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742516:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742527:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395023.742531:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742536:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742544:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffffa0b318946600) 00010000:00010000:0.0:1787395023.742546:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395023.742549:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742555:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a816b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742585:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a815d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21b3 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742599:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21b3 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395023.742607:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b318946a00) 00010000:00010000:0.0:1787395023.742609:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395023.742612:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011600, rc 0) 00000100:00100000:0.0:1787395023.742677:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+17:9671:x1874219304504960:12345-192.168.203.16@tcp:101:rm.0 Request processed in 746us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395023.742684:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:1.0:1787395023.748014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.748111:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304505216 00000100:00100000:2.0:1787395023.748120:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304505216 00000100:00100000:2.0:1787395023.748173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:2.0:1787395023.748182:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+17:9671:x1874219304505216:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:2.0:1787395023.748237:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787395023.748263:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21b3 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748285:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a811e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2197 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748296:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b318946a00) 00010000:00010000:2.0:1787395023.748351:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8133 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc219e expref: 15 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748361:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:2.0:1787395023.748364:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395023.748465:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748478:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748488:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748520:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748527:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748533:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748650:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748658:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.748664:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395023.750712:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787395023.750802:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295699494769ns, next at 296699489408ns, rc = 0 00010000:00010000:2.0:1787395023.750883:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.750898:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.750910:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.750919:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.750941:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.750946:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751006:0:5802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395023.751029:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751035:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751041:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751046:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.751051:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751059:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751071:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:2.0:1787395023.751074:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787395023.751078:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751084:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8187 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751103:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751115:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751120:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751125:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.751128:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751134:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751142:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:2.0:1787395023.751144:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395023.751147:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.751153:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8179 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395023.751165:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b8db81c reply state 000000009da6ff93 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395023.751174:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395023.751262:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304505216:12345-192.168.203.16@tcp:36:rm.0 Request processed in 3077us (3252us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787395023.751271:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00010000:00010000:3.0:1787395023.752071:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395023.752079:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.752087:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395023.752091:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.752110:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.752121:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:3.0:1787395023.752123:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787395023.752126:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.752131:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a818e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.752279:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395023.752281:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395023.752289:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395023.757903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395023.758076:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758090:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758098:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758104:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.758109:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758117:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758132:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffffa0b3112e7100) 00010000:00010000:2.0:1787395023.758136:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395023.758140:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.758146:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8180 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395023.758239:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304505472 00000100:00100000:3.0:1787395023.758249:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304505472 00000100:00100000:3.0:1787395023.758299:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:3.0:1787395023.758332:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:9671:x1874219304505472:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:3.0:1787395023.758955:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304505472:12345-192.168.203.16@tcp:35:rm.0 Request processed in 645us (1059us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787395023.758964:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:0.0:1787395023.766896:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395023.767058:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304505728 00000100:00100000:2.0:1787395023.767067:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304505728 00000100:00100000:2.0:1787395023.767124:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:2.0:1787395023.767134:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:9671:x1874219304505728:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:2.0:1787395023.767186:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787395023.767212:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a814f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ac expref: 16 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767251:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a80ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2189 expref: 15 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767261:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b308bf3300) 00010000:00010000:2.0:1787395023.767275:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49000/0xedbabbe2e89a80ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc217b expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767284:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7500) 00010000:00010000:2.0:1787395023.767293:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395023.767348:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767362:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767370:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767382:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767398:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.767405:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.768111:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.768132:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.768140:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395023.778698:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787395023.778721:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778732:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778740:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778746:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.778751:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778758:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778773:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395023.778776:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787395023.778781:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778791:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a81a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778819:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778838:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778844:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778849:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395023.778852:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778859:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778867:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:2.0:1787395023.778870:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395023.778872:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395023.778877:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8195 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395023.778893:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9b19298 reply state 0000000044c03dc0 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395023.778900:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395023.780059:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:9671:x1874219304505728:12345-192.168.203.16@tcp:36:rm.0 Request processed in 12919us (13164us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787395023.780069:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00010000:00010000:3.0:1787395023.792001:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792018:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792026:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792032:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395023.792037:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792059:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792074:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395023.792077:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395023.792082:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395023.792089:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a819c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395023.954774:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323408896:0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.954827:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323409152:0@lo:400:kworker.0 00000100:00100000:2.0:1787395023.954839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395023.954868:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323409024:0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.954890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395023.954922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395023.954927:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408896 00000100:00100000:2.0:1787395023.954934:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408896 00000100:00100000:3.0:1787395023.954937:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787395023.954942:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323408768:0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.954966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395023.954970:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409024 00000100:00100000:2.0:1787395023.954973:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409024 00000100:00100000:3.0:1787395023.954983:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323409280:0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.955006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395023.955007:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409152 00000100:00100000:2.0:1787395023.955010:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409152 00000100:00100000:2.0:1787395023.955026:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787395023.955030:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409280 00000100:00100000:3.0:1787395023.955033:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409280 00000100:00100000:2.0:1787395023.955034:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323408896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.955056:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787395023.955061:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323409280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395023.955081:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323408896:12345-0@lo:400:kworker.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.955088:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787395023.955090:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323409280:12345-0@lo:400:kworker.0 Request processed in 29us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.955095:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787395023.955105:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787395023.955110:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323409024:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787395023.955137:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae6a00 x1874219323409280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395023.955139:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323409024:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395023.955145:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787395023.955150:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323409280:0@lo:400:kworker.0 00000100:00100000:2.0:1787395023.955156:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787395023.955161:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323409152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.955173:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323409024:0@lo:400:kworker.0 00000100:00100000:2.0:1787395023.955188:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323409152:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.955191:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323409152:0@lo:400:kworker.0 00000100:00100000:2.0:1787395023.955194:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787395023.955215:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323408768 00000100:00100000:3.0:1787395023.955218:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323408768 00000100:00100000:3.0:1787395023.955241:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787395023.955247:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323408768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395023.955279:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323408768:12345-0@lo:400:kworker.0 Request processed in 32us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395023.955284:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787395023.955335:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323408768:0@lo:400:kworker.0 00000100:00080000:2.0:1787395023.960088:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787395023.960100:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395023.960157:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323408896:0@lo:400:kworker.0 00010000:00010000:2.0:1787395024.338536:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395024.467500:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323409408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395024.467567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395024.467693:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409408 00000100:00100000:1.0:1787395024.467701:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409408 00000100:00100000:1.0:1787395024.467764:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787395024.467772:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323409408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787395024.467803:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395024.467851:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323409408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395024.467865:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1787395024.467902:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3396b0e00 x1874219323409408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395024.467919:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323409408:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787395025.363551:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395026.389242:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395026.824280:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395026.824381:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395026.824407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395026.824548:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304505856 00000100:00100000:3.0:1787395026.824559:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304505856 00000100:00100000:3.0:1787395026.824609:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 245 00000100:00100000:3.0:1787395026.824619:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304505856:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395026.824687:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304505856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395026.824695:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 245 00000100:00100000:1.0:1787395026.824913:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506112 00000100:00100000:1.0:1787395026.824918:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506112 00000100:00100000:1.0:1787395026.824962:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:1.0:1787395026.824970:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304506112:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395026.825003:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304506112:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395026.825009:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00080000:3.0:1787395026.825284:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395026.825689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395026.828687:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304505984 00000100:00100000:2.0:1787395026.828700:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304505984 00000100:00100000:2.0:1787395026.828781:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506240 00000100:00100000:2.0:1787395026.828785:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506240 00000100:00100000:2.0:1787395026.828817:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:2.0:1787395026.828829:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:2365:x1874219304505984:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395026.828898:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:3.0:1787395026.828915:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304506240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395026.828915:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:2365:x1874219304505984:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 84us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395026.828928:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:3.0:1787395026.828968:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2365:x1874219304506240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 61us (3280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395026.828976:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00080000:2.0:1787395026.829067:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787395026.968516:0:11471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787395027.411578:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787395027.878482:0:11520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffd81f7170 00000020:00000080:3.0:1787395027.878499:0:11520:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787395027.878504:0:11520:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787395027.878511:0:11520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd81f9400 20000000:00000080:3.0:1787395027.878518:0:11520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b33675d400 uarg=0000000000000000 20000000:01000000:3.0:1787395027.878556:0:11520:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787395027.878563:0:11520:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787395027.878568:0:11520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1787395027.879499:0:11521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787395027.879670:0:11520:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787395027.888633:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787395027.888692:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787395027.888749:0:11520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787395027.888770:0:11520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787395027.888807:0:11520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888828:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888836:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888842:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888853:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888874:0:11520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888881:0:11520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888936:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.888954:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 12 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395027.888969:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409536:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395027.889123:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889131:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395027.889140:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409664:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395027.889170:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889178:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 18 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395027.889186:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409792:0@lo:104: 00000100:00100000:3.0:1787395027.889234:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787395027.889283:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889291:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395027.889299:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409920:0@lo:104: 00000100:00100000:3.0:1787395027.889348:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395027.889391:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409792 00000100:00100000:3.0:1787395027.889398:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409792 00000100:00100000:3.0:1787395027.889434:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323409920 00000100:00100000:3.0:1787395027.889437:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323409920 00000100:00100000:3.0:1787395027.889453:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787395027.889461:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:11520:x1874219323409792:12345-0@lo:104: 00010000:00010000:3.0:1787395027.889474:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889517:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787395027.889523:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+4:11520:x1874219323409792:12345-0@lo:104: Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395027.889530:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787395027.889548:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787395027.889555:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11520:x1874219323409920:12345-0@lo:104: 00010000:00010000:3.0:1787395027.889562:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889594:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787395027.889599:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11520:x1874219323409920:12345-0@lo:104: Request processed in 46us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395027.889614:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787395027.889634:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395027.889640:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889646:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031a00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395027.889650:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889659:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395027.889666:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395027.889672:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787395027.889700:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889707:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395027.889726:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889733:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031a00/0xedbabbe2e89a8068 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a806f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889746:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395027.889749:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889767:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395027.889770:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889777:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395027.889784:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395027.889788:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787395027.889800:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889806:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395027.889821:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889827:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a805a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8061 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889836:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395027.889837:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395027.889840:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395027.889852:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323410048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395027.889878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395027.889908:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323410176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395027.889929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787395027.889976:0:11520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.889984:0:11520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 18 pid: 5795 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395027.889992:0:11520:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323410304:0@lo:104: 00000100:00100000:3.0:1787395027.890015:0:11520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395027.890041:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787395027.890050:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410304 00000100:00100000:3.0:1787395027.890053:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410304 00000100:00100000:3.0:1787395027.890071:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787395027.890076:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f67a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11520:x1874219323410304:12345-0@lo:104: 00010000:00010000:3.0:1787395027.890083:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.890112:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787395027.890117:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f67a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+3:11520:x1874219323410304:12345-0@lo:104: Request processed in 41us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395027.890123:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787395027.890161:0:11520:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa6ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395027.890180:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409792:0@lo:104: 00000100:00100000:3.0:1787395027.890186:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409920:0@lo:104: 00000100:00100000:3.0:1787395027.890192:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323410304:0@lo:104: 00010000:00010000:2.0:1787395027.890347:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395027.890353:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890370:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010c00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1787395027.890372:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890379:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787395027.890386:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395027.890391:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787395027.890407:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890423:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787395027.890437:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890443:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a804c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a8053 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890457:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395027.890458:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395027.890460:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395027.890470:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410048 00000100:00100000:2.0:1787395027.890473:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410048 00010000:00010000:2.0:1787395027.890490:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 19 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.890510:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410176 00000100:00100000:2.0:1787395027.890513:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410176 00010000:00010000:2.0:1787395027.890524:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 20 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.890535:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787395027.890541:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+20:3304:x1874219323410048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395027.890550:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395027.890555:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 20 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890563:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 20 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890576:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55d600/0xedbabbe2e89a806f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a8068 expref: 20 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890594:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395027.890627:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323410048:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395027.890633:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787395027.890648:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787395027.890653:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:3305:x1874219323410176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395027.890661:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395027.890665:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890673:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890683:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8061 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a805a expref: 18 pid: 5797 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.890692:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395027.890713:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:3305:x1874219323410176:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395027.890719:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1787395027.890734:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395027.890755:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323410048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395027.891469:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323410176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395027.891486:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787395027.891493:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323410432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395027.891541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395027.892129:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410432 00000100:00100000:0.0:1787395027.892137:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410432 00010000:00010000:0.0:1787395027.892162:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395027.892191:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787395027.892268:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:3305:x1874219323410432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395027.892279:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395027.892284:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395027.892294:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395027.892330:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a8053 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a804c expref: 17 pid: 5795 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395027.892343:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395027.892393:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3305:x1874219323410432:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395027.892400:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787395027.892457:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323410432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787395027.898541:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409536:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395027.898566:0:11520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11520:1874219323409664:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395027.898746:0:11520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.900461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395027.900496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395027.900519:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506368 00000100:00100000:2.0:1787395027.900527:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506368 00010000:00010000:2.0:1787395027.900570:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 13 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.900602:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506496 00000100:00100000:2.0:1787395027.900605:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506496 00010000:00010000:2.0:1787395027.900614:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 14 pid: 5797 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.900625:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:2.0:1787395027.900632:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+14:2364:x1874219304506368:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395027.900645:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395027.900650:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 14 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900660:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 14 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900676:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a807d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc216d expref: 14 pid: 5795 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900689:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395027.900709:0:5787:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787395027.900720:0:5787:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787395027.900751:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304506368:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 117us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395027.900759:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:2.0:1787395027.900788:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:2.0:1787395027.900793:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:2364:x1874219304506496:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395027.900799:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395027.900802:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900808:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900815:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300030a00/0xedbabbe2e89a8076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2166 expref: 12 pid: 5797 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900824:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900829:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900839:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900846:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900852:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900859:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900864:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55de00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395027.900874:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900882:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900905:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395027.900916:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395027.900937:0:11520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395027.900938:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2364:x1874219304506496:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 143us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395027.900953:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00010000:00010000:3.0:1787395027.900957:0:11520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395027.900966:0:11520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395028.434470:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787395028.562573:0:6965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300511264557ns, next at 301511262365ns, rc = 0 00000100:00100000:1.0:1787395028.562615:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323410560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395028.562699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395028.562753:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410560 00000100:00100000:2.0:1787395028.562761:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410560 00000100:00100000:2.0:1787395028.562824:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787395028.562834:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323410560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395028.562867:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395028.562913:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323410560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395028.562920:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787395028.562979:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787395028.563084:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33fae7480 x1874219323410560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395028.563102:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323410560:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787395028.585860:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00080000:0.0:1787395028.585878:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1787395028.585896:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787395028.585902:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787395028.586074:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323410688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787395028.586209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395028.586247:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410688 00000100:00100000:1.0:1787395028.586255:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410688 00000100:00100000:0.0:1787395028.586535:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787395028.586546:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323410688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787395028.586575:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787395028.586610:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a897bcf, atime: 0x6a897bcf, ctime: 0x6a897bcf, blocks: 0x1 00010000:00010000:0.0:1787395028.586619:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395028.586634:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:0.0:1787395028.586638:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395028.586644:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395028.586661:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395028.586671:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395028.586679:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395028.586711:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395028.587376:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395028.587384:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395028.587394:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395028.587399:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395028.587426:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395028.587448:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395028.587455:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e769839/0xedbabbe2e89a81b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395028.587486:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395028.587488:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395028.587490:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395028.587727:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323410688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1180us (1516us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787395028.587747:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787395028.588843:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b33fae5500/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787395028.588855:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323410688:0@lo:6:osp-syn-0-0.0 10000000:01000000:0.0:1787395029.074425:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787395029.074434:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f645800 from 7 10000000:01000000:0.0:1787395029.074454:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787395029.074498:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395029.074511:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395029.074522:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395029.074547:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323410816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787395029.074611:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078567:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395029.078632:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323411072:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.078698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078740:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787395029.078748:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323410944:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.078770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078788:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323411456:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.078811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078854:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323411200:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.078880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078898:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395029.078903:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323411328:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.078924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.078956:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411456 00000100:00100000:0.0:1787395029.078963:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411456 00000100:00100000:0.0:1787395029.079014:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411200 00000100:00100000:0.0:1787395029.079028:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411200 00000100:00100000:0.0:1787395029.079051:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787395029.079059:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323411456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079111:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323411456:12345-0@lo:400:kworker.0 Request processed in 52us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.079118:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787395029.079133:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787395029.079139:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323411200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079169:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323411200:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.079175:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787395029.079208:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323411200:0@lo:400:kworker.0 00010000:00080000:0.0:1787395029.079237:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336574a80 x1874219323411456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395029.079248:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323411456:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079296:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411072 00000100:00100000:0.0:1787395029.079300:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411072 00000100:00100000:0.0:1787395029.079346:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410944 00000100:00100000:0.0:1787395029.079361:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410944 00000100:00100000:0.0:1787395029.079374:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411328 00000100:00100000:0.0:1787395029.079376:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411328 00000100:00100000:0.0:1787395029.079390:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787395029.079396:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323411072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079466:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323411072:12345-0@lo:400:kworker.0 Request processed in 69us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.079472:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787395029.079491:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787395029.079497:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323410944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079524:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323410944:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.079529:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787395029.079540:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787395029.079546:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323411328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079576:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323411328:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.079581:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787395029.079632:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323411328:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079654:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323410944:0@lo:400:kworker.0 00000100:00100000:0.0:1787395029.079663:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323411072:0@lo:400:kworker.0 00000100:00080000:3.0:1787395029.080682:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787395029.080689:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787395029.080702:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323410816 00000100:00100000:3.0:1787395029.080708:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323410816 00000100:00100000:3.0:1787395029.080743:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787395029.080751:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:5799:x1874219323410816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395029.080763:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395029.080782:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a81b8 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.080805:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a81b8 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.080823:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a81b8 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.080833:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55de00, rc 0) 00000100:00100000:3.0:1787395029.080878:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323410816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (6269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.080885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787395029.081088:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323410816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395029.081103:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.081113:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395029.081172:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323411584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.081200:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.081222:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa6ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.081232:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411584 00000100:00100000:3.0:1787395029.081235:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411584 00000100:00100000:3.0:1787395029.081254:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787395029.081260:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323411584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.081465:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323411584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.081472:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787395029.081500:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323411584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.081532:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323411712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.081566:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.081579:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33fa6ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.081590:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411712 00000100:00100000:3.0:1787395029.081593:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411712 00000100:00100000:3.0:1787395029.081613:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787395029.081619:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323411712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.081748:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323411712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.081755:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787395029.081790:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323411712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.083969:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11534:1874219323411840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.084029:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.084054:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411840 00000100:00100000:3.0:1787395029.084060:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411840 00000100:00100000:3.0:1787395029.084088:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787395029.084095:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:11534:x1874219323411840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.085340:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:11534:x1874219323411840:12345-0@lo:502:llog_process_th.0 Request processed in 1240us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.085382:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787395029.085807:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30302b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.085832:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11534:1874219323411840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787395029.085865:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395029.085875:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.085882:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787395029.085889:0:11534:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b33f645800 00000020:00000080:3.0:1787395029.085892:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787395029.085967:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11534:1874219323411968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.086012:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.086060:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323411968 00000100:00100000:3.0:1787395029.086065:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323411968 00000100:00100000:3.0:1787395029.086097:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787395029.086104:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:11534:x1874219323411968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.086245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:11534:x1874219323411968:12345-0@lo:502:llog_process_th.0 Request processed in 141us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.086252:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787395029.086527:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30302b300 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.086618:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11534:1874219323411968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787395029.086639:0:11534:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395029.086643:0:11534:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.086645:0:11534:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787395029.086648:0:11534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787395029.086700:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787395029.086715:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787395029.086725:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086736:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395029.086745:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787395029.086748:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b305de9800 from 7 10000000:01000000:3.0:1787395029.086751:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787395029.086778:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086786:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086794:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395029.086807:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.086835:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.086850:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32024d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.086863:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412096 00000100:00100000:3.0:1787395029.086866:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412096 00000100:00100000:3.0:1787395029.086889:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787395029.086895:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:5799:x1874219323412096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395029.086904:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395029.086915:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a81cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a81c6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086936:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a81cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a81c6 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086946:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a81cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a81c6 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.086955:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55cc00, rc 0) 00000100:00100000:3.0:1787395029.086983:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.086988:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787395029.087025:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395029.087036:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.087044:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395029.087080:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.087100:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.087111:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32024d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.087120:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412224 00000100:00100000:3.0:1787395029.087124:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412224 00000100:00100000:3.0:1787395029.087141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787395029.087147:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.087340:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.088562:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787395029.088620:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.088657:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.088702:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.088728:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30302b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.088744:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412352 00000100:00100000:3.0:1787395029.088748:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412352 00000100:00100000:3.0:1787395029.088776:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787395029.088783:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.089015:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.089029:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787395029.089079:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.089283:0:11536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11536:1874219323412480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.089339:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.089374:0:11536:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6480 going to sleep for 11 seconds 00000100:00100000:0.0:1787395029.089389:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412480 00000100:00100000:0.0:1787395029.089393:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412480 00000100:00100000:0.0:1787395029.089421:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787395029.089428:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:11536:x1874219323412480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787395029.089550:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b305cb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:11536:x1874219323412480:12345-0@lo:502:llog_process_th.0 Request processed in 122us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.089558:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787395029.089578:0:11536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11536:1874219323412480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787395029.089602:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395029.089610:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.089613:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787395029.089620:0:11536:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b305de9800 00000020:00000080:3.0:1787395029.089623:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787395029.089695:0:11536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11536:1874219323412608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.089728:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.089746:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412608 00000100:00100000:3.0:1787395029.089750:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412608 00000100:00100000:3.0:1787395029.089771:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787395029.089777:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:11536:x1874219323412608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.089991:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3205a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:11536:x1874219323412608:12345-0@lo:502:llog_process_th.0 Request processed in 213us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.089998:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787395029.090026:0:11536:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.090039:0:11536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11536:1874219323412608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787395029.090060:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395029.090064:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.090071:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787395029.090075:0:11536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787395029.090118:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787395029.090135:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787395029.090143:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090154:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395029.090162:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787395029.090165:0:5799:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b318a89000 from 7 10000000:01000000:3.0:1787395029.090167:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787395029.090187:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090196:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090204:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395029.090217:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.090246:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.090260:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6480 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.090274:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412736 00000100:00100000:3.0:1787395029.090278:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412736 00000100:00100000:3.0:1787395029.090302:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787395029.090330:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:5799:x1874219323412736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395029.090339:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395029.090368:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a81db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a81d4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090386:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a81db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a81d4 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090393:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a81db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a81d4 expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395029.090400:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c600, rc 0) 00000100:00100000:3.0:1787395029.090428:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323412736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.090436:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787395029.090454:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787395029.090466:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395029.090484:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395029.090528:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395029.090559:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395029.090584:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32ffec240 going to sleep for 11 seconds 00000100:00100000:0.0:1787395029.090595:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412864 00000100:00100000:0.0:1787395029.090598:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412864 00000100:00100000:0.0:1787395029.090620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787395029.090626:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323412864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395029.090812:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323412864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.090819:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787395029.090910:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.090939:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.090985:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.091004:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787395029.091020:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323412992 00000100:00100000:2.0:1787395029.091026:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323412992 00000100:00100000:2.0:1787395029.091060:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787395029.091072:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323412992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787395029.091214:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:5799:x1874219323412992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395029.091368:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787395029.091432:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:5799:1874219323412992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.091818:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11538:1874219323413120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.091856:0:11538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.091886:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413120 00000100:00100000:3.0:1787395029.091891:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413120 00000100:00100000:3.0:1787395029.091925:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787395029.091934:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:11538:x1874219323413120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787395029.092018:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787395029.092505:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:11538:x1874219323413120:12345-0@lo:502:llog_process_th.0 Request processed in 572us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.092516:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11538:1874219323413120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787395029.092517:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000020:01000000:3.0:1787395029.092545:0:11538:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395029.092553:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.092555:0:11538:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787395029.092566:0:11538:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b318a89000 00000020:00000080:3.0:1787395029.092568:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787395029.092629:0:11538:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11538:1874219323413248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.092659:0:11538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395029.092681:0:11538:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32fcd6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787395029.092699:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413248 00000100:00100000:3.0:1787395029.092703:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413248 00000100:00100000:3.0:1787395029.092725:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787395029.092731:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:11538:x1874219323413248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395029.092840:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:11538:x1874219323413248:12345-0@lo:502:llog_process_th.0 Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.092847:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787395029.092882:0:11538:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:11538:1874219323413248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787395029.092901:0:11538:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395029.092905:0:11538:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395029.092907:0:11538:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787395029.092911:0:11538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787395029.092964:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787395029.092997:0:5799:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787395029.093006:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.093017:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395029.102182:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1787395029.102790:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1787395029.458571:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395029.586538:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323413376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395029.586600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395029.586717:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413376 00000100:00100000:1.0:1787395029.586725:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413376 00000100:00100000:1.0:1787395029.586771:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787395029.586779:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323413376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787395029.586820:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395029.590456:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323413376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3669us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395029.590470:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787395029.590558:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3396b2300 x1874219323413376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395029.590579:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323413376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395029.762477:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395029.762577:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506624 00000100:00100000:2.0:1787395029.762586:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506624 00000100:00100000:2.0:1787395029.762645:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 261 00000100:00100000:2.0:1787395029.762656:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:5579:x1874219304506624:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395029.762672:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395029.762690:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a81e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21ba expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.762718:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a81e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ba expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.762728:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a81e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ba expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.762753:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48400, rc 0) 00000100:00100000:2.0:1787395029.762816:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304506624:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 161us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395029.762823:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 261 00000100:00100000:1.0:1787395029.769981:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395029.770073:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506752 00000100:00100000:2.0:1787395029.770082:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506752 00000100:00100000:2.0:1787395029.770209:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 262 00000100:00100000:2.0:1787395029.770222:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304506752:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787395029.771207:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304506752:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 982us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395029.771218:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 262 00000100:00100000:0.0:1787395029.786114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395029.786251:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304506880 00000100:00100000:3.0:1787395029.786271:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304506880 00000100:00100000:3.0:1787395029.786438:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 263 00000100:00100000:3.0:1787395029.786455:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304506880:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.786819:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304506880:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 365us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.786833:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 263 00000100:00100000:1.0:1787395029.796265:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395029.796466:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507008 00000100:00100000:2.0:1787395029.796476:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507008 00000100:00100000:2.0:1787395029.796530:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 264 00000100:00100000:2.0:1787395029.796540:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:9941:x1874219304507008:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787395029.797278:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:9941:x1874219304507008:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 736us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395029.797288:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 264 00000100:00100000:1.0:1787395029.804275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395029.804458:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507136 00000100:00100000:3.0:1787395029.804472:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507136 00000100:00100000:3.0:1787395029.804537:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 265 00000100:00100000:3.0:1787395029.804567:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:9941:x1874219304507136:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787395029.804887:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308336c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:9941:x1874219304507136:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 320us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.804895:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 265 00000100:00100000:0.0:1787395029.815819:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395029.815989:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507264 00000100:00100000:2.0:1787395029.816003:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507264 00000100:00100000:2.0:1787395029.816068:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 266 00000100:00100000:2.0:1787395029.816081:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:5579:x1874219304507264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395029.816097:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395029.816115:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa49000/0xedbabbe2e89a81e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21c1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.816171:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa49000/0xedbabbe2e89a81e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.816184:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa49000/0xedbabbe2e89a81e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395029.816193:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49000, rc 0) 00000100:00100000:2.0:1787395029.816258:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304507264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 180us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395029.816265:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 266 00000100:00100000:1.0:1787395029.825519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395029.825811:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507392 00000100:00100000:0.0:1787395029.825824:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507392 00000100:00100000:0.0:1787395029.825900:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 267 00000100:00100000:0.0:1787395029.825912:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304507392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395029.826367:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304507392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 456us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.826376:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 267 00000100:00100000:1.0:1787395029.833485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395029.833802:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507520 00000100:00100000:3.0:1787395029.833815:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507520 00000100:00100000:3.0:1787395029.833892:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 268 00000100:00100000:3.0:1787395029.833904:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304507520:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395029.834206:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:5579:x1874219304507520:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 303us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.834215:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 268 00000100:00100000:0.0:1787395029.837368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395029.838084:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507648 00000100:00100000:3.0:1787395029.838100:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507648 00000100:00100000:3.0:1787395029.838187:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 269 00000100:00100000:3.0:1787395029.838199:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:9944:x1874219304507648:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787395029.838928:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:9944:x1874219304507648:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 727us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395029.838940:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 269 00000100:00100000:1.0:1787395029.847822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395029.848127:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507776 00000100:00100000:0.0:1787395029.848159:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507776 00000100:00100000:0.0:1787395029.848229:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 270 00000100:00100000:0.0:1787395029.848241:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:9944:x1874219304507776:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787395029.848779:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b308335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:9944:x1874219304507776:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 537us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395029.848789:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 270 00000040:00080000:2.0:1787395030.162934:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787395030.482621:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395031.506519:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395031.938931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395031.939081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395031.939458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395031.939502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395031.939535:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508160 00000100:00100000:1.0:1787395031.939549:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508160 00000100:00100000:1.0:1787395031.939611:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787395031.939621:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304508160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395031.939695:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304508160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395031.939703:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00080000:1.0:1787395031.939724:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395031.940582:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508032 00000100:00100000:2.0:1787395031.940591:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508032 00000100:00100000:2.0:1787395031.940784:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508288 00000100:00100000:2.0:1787395031.940789:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508288 00000100:00100000:3.0:1787395031.940923:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304507904 00000100:00100000:3.0:1787395031.940927:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304507904 00000100:00100000:3.0:1787395031.940962:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 271 00000100:00100000:3.0:1787395031.940971:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304507904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395031.941025:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304507904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 55us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395031.941049:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 271 00000100:00080000:1.0:1787395031.941049:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395031.941081:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:1.0:1787395031.941090:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304508032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395031.941133:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304508032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395031.941140:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:2.0:1787395031.941365:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:2.0:1787395031.941372:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304508288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395031.941407:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304508288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395031.941413:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 97 00010000:00010000:2.0:1787395032.530919:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395033.554862:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395033.682999:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787395033.683034:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323413504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395033.683129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395033.683249:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413504 00000100:00100000:2.0:1787395033.683260:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413504 00000100:00100000:2.0:1787395033.683362:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787395033.683373:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323413504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395033.683440:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787395033.683588:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395033.687249:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323413504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3858us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395033.687271:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787395033.687516:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787395033.687526:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b33fae5500, transno 4294967300 00000100:00100000:3.0:1787395033.687564:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323413504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395034.196290:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323413632:0@lo:400:kworker.0 00000100:00100000:2.0:1787395034.196984:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323413888:0@lo:400:kworker.0 00000100:00100000:2.0:1787395034.197038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395034.197060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.197227:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323413760:0@lo:400:kworker.0 00000100:00100000:0.0:1787395034.197262:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.197285:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323414272:0@lo:400:kworker.0 00000100:00100000:0.0:1787395034.197339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.197379:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323414016:0@lo:400:kworker.0 00000100:00100000:0.0:1787395034.197404:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.197437:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414272 00000100:00100000:0.0:1787395034.197446:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414272 00000100:00100000:0.0:1787395034.197505:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414016 00000100:00100000:0.0:1787395034.197509:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414016 00000100:00100000:0.0:1787395034.197528:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787395034.197537:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323414272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395034.197573:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323414144:0@lo:400:kworker.0 00000100:00100000:3.0:1787395034.197598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.197600:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323414272:12345-0@lo:400:kworker.0 Request processed in 63us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395034.197608:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787395034.197625:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787395034.197629:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413632 00000100:00100000:0.0:1787395034.197631:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323414016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395034.197632:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413632 00000100:00100000:3.0:1787395034.197660:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787395034.197664:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323414016:12345-0@lo:400:kworker.0 Request processed in 33us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395034.197666:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323413632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395034.197690:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787395034.197697:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323413632:12345-0@lo:400:kworker.0 Request processed in 31us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395034.197703:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1787395034.197710:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787395034.197733:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413888 00000100:00100000:3.0:1787395034.197737:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413888 00000100:00100000:3.0:1787395034.197769:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323413760 00000100:00100000:3.0:1787395034.197771:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323413760 00000100:00100000:3.0:1787395034.197783:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414144 00000100:00100000:3.0:1787395034.197785:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414144 00000100:00100000:3.0:1787395034.197801:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787395034.197815:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323413888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395034.197987:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787395034.197997:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323413760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395034.198034:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323413760:12345-0@lo:400:kworker.0 Request processed in 39us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395034.198041:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787395034.198054:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787395034.198061:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323414144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395034.198086:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323414144:12345-0@lo:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395034.198093:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787395034.198157:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323413760:0@lo:400:kworker.0 00010000:00080000:1.0:1787395034.198173:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b327c8a300 x1874219323414272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395034.198183:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323414272:0@lo:400:kworker.0 00000100:00100000:2.0:1787395034.198191:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323413632:0@lo:400:kworker.0 00000100:00100000:2.0:1787395034.198201:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323414144:0@lo:400:kworker.0 00000100:00080000:2.0:1787395034.198218:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395034.198224:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323414016:0@lo:400:kworker.0 00000100:00100000:3.0:1787395034.200165:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323413888:12345-0@lo:400:kworker.0 Request processed in 2336us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395034.200183:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787395034.200262:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323413888:0@lo:400:kworker.0 00010000:00010000:2.0:1787395034.579593:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395034.707983:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787395034.714398:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323414400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395034.714483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395034.714854:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414400 00000100:00100000:0.0:1787395034.714870:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414400 00000100:00100000:0.0:1787395034.714947:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787395034.714958:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323414400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395034.715012:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395034.715121:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323414400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395034.715129:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787395034.717488:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336226a00 x1874219323414400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395034.717557:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323414400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787395035.604194:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395036.626461:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395037.060411:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395037.060493:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395037.060579:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395037.060616:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395037.060708:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508416 00000100:00100000:1.0:1787395037.060718:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508416 00000100:00100000:1.0:1787395037.060768:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 273 00000100:00100000:1.0:1787395037.060778:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304508416:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395037.060869:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304508416:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395037.060876:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 273 00000100:00100000:2.0:1787395037.061229:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508544 00000100:00100000:2.0:1787395037.061234:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508544 00000100:00100000:2.0:1787395037.061352:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508800 00000100:00100000:2.0:1787395037.061356:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508800 00000100:00100000:3.0:1787395037.061528:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:3.0:1787395037.061538:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304508544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395037.061584:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304508544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 49us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395037.061591:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00080000:1.0:1787395037.061880:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395037.061980:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:2.0:1787395037.061987:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304508800:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395037.062229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304508800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 241us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395037.062236:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:0.0:1787395037.068447:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508672 00000100:00100000:0.0:1787395037.068463:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508672 00000100:00080000:1.0:1787395037.068546:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395037.068563:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:0.0:1787395037.068575:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304508672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395037.068664:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304508672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 91us (8046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395037.068673:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00010000:00010000:2.0:1787395037.651010:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395038.674699:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395038.802611:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323414528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395038.802681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395038.802715:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414528 00000100:00100000:0.0:1787395038.802724:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414528 00000100:00100000:0.0:1787395038.802910:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787395038.802920:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323414528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395038.802957:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395038.803004:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323414528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395038.803012:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787395038.803051:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395038.803095:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323414528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395039.316975:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323414656:0@lo:400:kworker.0 00000100:00100000:2.0:1787395039.317041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395039.317111:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414656 00000100:00100000:0.0:1787395039.317120:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414656 00000100:00100000:0.0:1787395039.317183:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787395039.317192:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323414656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317268:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323414912:0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395039.317344:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323415040:0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317362:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787395039.317370:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323414784:0@lo:400:kworker.0 00000100:00100000:1.0:1787395039.317382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395039.317400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395039.317411:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395039.317420:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323415168:0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317424:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323415296:0@lo:400:kworker.0 00000100:00100000:1.0:1787395039.317455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395039.317459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395039.317502:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415040 00000100:00100000:1.0:1787395039.317506:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415040 00000100:00100000:3.0:1787395039.317508:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414912 00000100:00100000:3.0:1787395039.317513:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414912 00000100:00100000:3.0:1787395039.317543:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323414784 00000100:00100000:3.0:1787395039.317554:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323414784 00000100:00100000:3.0:1787395039.317566:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415168 00000100:00100000:3.0:1787395039.317569:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415168 00000100:00100000:3.0:1787395039.317581:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787395039.317587:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323414912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317637:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323414912:12345-0@lo:400:kworker.0 Request processed in 49us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395039.317644:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787395039.317659:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787395039.317665:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323414784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317685:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323414784:12345-0@lo:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395039.317691:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787395039.317704:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787395039.317709:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323415168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317736:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323415168:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395039.317742:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787395039.317764:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415296 00000100:00100000:3.0:1787395039.317767:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415296 00000100:00100000:3.0:1787395039.317788:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787395039.317794:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323415296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.317821:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323415296:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395039.317826:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787395039.317861:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323415168:0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.318018:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323414784:0@lo:400:kworker.0 00010000:00080000:3.0:1787395039.318030:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336576680 x1874219323415296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395039.318057:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323415296:0@lo:400:kworker.0 00000100:00100000:3.0:1787395039.318067:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323414912:0@lo:400:kworker.0 00000100:00080000:3.0:1787395039.318223:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395039.318228:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395039.318615:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323414656:12345-0@lo:400:kworker.0 Request processed in 1421us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395039.318635:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787395039.320484:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787395039.320496:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323415040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395039.320601:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323415040:12345-0@lo:400:kworker.0 Request processed in 97us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395039.320609:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787395039.320659:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323415040:0@lo:400:kworker.0 00000100:00100000:2.0:1787395039.323913:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323414656:0@lo:400:kworker.0 00010000:00010000:3.0:1787395039.699435:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395039.826667:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323415424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395039.826732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395039.827204:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415424 00000100:00100000:0.0:1787395039.827213:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415424 00000100:00100000:0.0:1787395039.827265:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787395039.827282:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323415424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395039.827345:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395039.827400:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323415424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395039.827417:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787395039.827563:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b336226a00 x1874219323415424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395039.827578:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323415424:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787395040.402886:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787395040.728384:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395041.746516:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395042.178676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395042.178729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395042.178754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395042.178788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395042.178816:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509056 00000100:00100000:2.0:1787395042.178824:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509056 00000100:00100000:2.0:1787395042.178870:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509312 00000100:00100000:2.0:1787395042.178873:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509312 00000100:00100000:1.0:1787395042.179035:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304508928 00000100:00100000:1.0:1787395042.179039:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304508928 00000100:00100000:1.0:1787395042.179067:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 275 00000100:00100000:1.0:1787395042.179076:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304508928:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395042.179149:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304508928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 74us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395042.179157:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 275 00000100:00100000:1.0:1787395042.179206:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 106 00000100:00100000:1.0:1787395042.179214:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509056:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395042.179243:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395042.179250:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 106 00000100:00100000:1.0:1787395042.179272:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 107 00000100:00100000:1.0:1787395042.179278:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304509312:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395042.179299:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304509312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395042.179326:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 107 00000100:00100000:3.0:1787395042.179624:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509184 00000100:00100000:3.0:1787395042.179628:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509184 00000100:00100000:3.0:1787395042.179665:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:3.0:1787395042.179672:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509184:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395042.179698:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395042.179704:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00080000:3.0:1787395042.179720:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787395042.179735:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787395042.770520:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395043.795478:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395043.923756:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323415552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395043.923832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395043.923962:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415552 00000100:00100000:2.0:1787395043.923971:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415552 00000100:00080000:3.0:1787395043.924000:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395043.924026:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787395043.924038:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323415552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395043.924069:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395043.924166:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323415552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395043.924174:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787395043.924228:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323415552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395044.434956:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323415936:0@lo:400:kworker.0 00000100:00100000:3.0:1787395044.434980:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323415808:0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435100:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323415680:0@lo:400:kworker.0 00000100:00100000:3.0:1787395044.435102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395044.435151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395044.435158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395044.435183:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323416320:0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435183:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323416192:0@lo:400:kworker.0 00000100:00100000:0.0:1787395044.435208:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415808 00000100:00100000:1.0:1787395044.435211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395044.435215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395044.435218:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415808 00000100:00100000:1.0:1787395044.435236:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395044.435255:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323416064:0@lo:400:kworker.0 00000100:00100000:0.0:1787395044.435277:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415936 00000100:00100000:1.0:1787395044.435282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395044.435282:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415936 00000100:00100000:3.0:1787395044.435295:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416192 00000100:00100000:3.0:1787395044.435300:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416192 00000100:00100000:1.0:1787395044.435336:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323415680 00000100:00100000:1.0:1787395044.435339:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323415680 00000100:00100000:0.0:1787395044.435340:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787395044.435355:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395044.435358:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787395044.435366:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787395044.435369:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323415936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435372:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323415680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395044.435418:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323415936:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395044.435418:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323415680:12345-0@lo:400:kworker.0 Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395044.435426:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323415808:12345-0@lo:400:kworker.0 Request processed in 74us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395044.435429:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787395044.435439:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787395044.435465:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416320 00000100:00100000:1.0:1787395044.435470:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416320 00000100:00100000:1.0:1787395044.435501:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416064 00000100:00100000:1.0:1787395044.435504:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416064 00000100:00100000:1.0:1787395044.435529:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787395044.435538:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323416320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435574:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323416320:12345-0@lo:400:kworker.0 Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395044.435581:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787395044.435592:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787395044.435599:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323416064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435639:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323416064:12345-0@lo:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395044.435646:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787395044.435673:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787395044.435680:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787395044.435716:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323416064:0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435725:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323415680:0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.435776:0:5802:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787395044.436664:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787395044.436686:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787395044.436697:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323416192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.436754:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323416192:12345-0@lo:400:kworker.0 Request processed in 60us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395044.436761:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1787395044.436779:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787395044.436783:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395044.436819:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323415936:0@lo:400:kworker.0 00000100:00100000:1.0:1787395044.436819:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323416192:0@lo:400:kworker.0 00000100:00100000:3.0:1787395044.436848:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323415808:0@lo:400:kworker.0 00010000:00080000:3.0:1787395044.436861:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633ce00 x1874219323416320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395044.436871:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323416320:0@lo:400:kworker.0 00010000:00010000:2.0:1787395044.818704:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395044.946583:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787395044.946610:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323416448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395044.946682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395044.948040:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416448 00000100:00100000:2.0:1787395044.948053:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416448 00000100:00100000:2.0:1787395044.948499:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787395044.948512:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323416448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395044.948555:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395044.948633:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323416448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395044.948641:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787395044.948740:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633e300 x1874219323416448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395044.948762:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323416448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787395045.842481:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395046.867223:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395047.299716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395047.299863:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395047.299994:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509568 00000100:00100000:2.0:1787395047.300017:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509568 00000100:00100000:2.0:1787395047.300123:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00100000:2.0:1787395047.300148:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509568:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395047.300277:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304509568:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 132us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395047.300301:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00080000:1.0:1787395047.300543:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395047.302910:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509440 00000100:00100000:3.0:1787395047.302938:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509440 00000100:00100000:3.0:1787395047.303162:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 277 00000100:00100000:3.0:1787395047.303172:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304509440:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395047.303279:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304509440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 108us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395047.303304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 277 00000100:00100000:1.0:1787395047.310842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395047.312388:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509824 00000100:00100000:2.0:1787395047.312400:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509824 00000100:00100000:2.0:1787395047.312548:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00100000:2.0:1787395047.312569:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304509824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395047.312660:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304509824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 102us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395047.312667:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00080000:1.0:1787395047.312916:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395047.318984:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395047.319343:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509696 00000100:00100000:1.0:1787395047.319356:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509696 00000100:00080000:3.0:1787395047.319507:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395047.319620:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:1.0:1787395047.319633:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2362:x1874219304509696:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:1.0:1787395047.319686:0:8490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a8125 00000100:00080000:1.0:1787395047.319698:0:8490:0:(import.c:65:import_set_state_nolock()) ffffa0b20324f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787395047.319755:0:8490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1787395047.320294:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395047.320296:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+2:2362:x1874219304509696:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 661us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395047.320343:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00010000:00010000:3.0:1787395047.894367:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395048.915500:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395049.043285:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323416576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395049.043397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.043479:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416576 00000100:00100000:2.0:1787395049.043492:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416576 00000100:00100000:2.0:1787395049.043583:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787395049.043598:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323416576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395049.043654:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395049.043743:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323416576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395049.043751:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787395049.043802:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395049.049135:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323416576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395049.557062:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323416704:0@lo:400:kworker.0 00000100:00100000:2.0:1787395049.557156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557219:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323417216:0@lo:400:kworker.0 00000100:00100000:2.0:1787395049.557253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557284:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787395049.557292:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323417088:0@lo:400:kworker.0 00000100:00100000:2.0:1787395049.557357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557400:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323416832:0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.557408:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417088 00000100:00100000:1.0:1787395049.557417:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417088 00000100:00100000:2.0:1787395049.557433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557457:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323417344:0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.557465:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417216 00000100:00100000:0.0:1787395049.557471:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417216 00000100:00100000:2.0:1787395049.557485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557506:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787395049.557512:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323416960:0@lo:400:kworker.0 00000100:00100000:2.0:1787395049.557535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395049.557564:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416704 00000100:00100000:2.0:1787395049.557568:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416704 00000100:00100000:2.0:1787395049.557602:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787395049.557612:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323416704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.557613:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417344 00000100:00100000:1.0:1787395049.557619:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417344 00000100:00100000:1.0:1787395049.557651:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787395049.557659:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.557675:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416832 00000100:00100000:0.0:1787395049.557680:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416832 00000100:00100000:0.0:1787395049.557706:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323416960 00000100:00100000:0.0:1787395049.557709:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323416960 00000100:00100000:1.0:1787395049.557714:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323417088:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395049.557724:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787395049.557729:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787395049.557749:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.557785:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323417216:12345-0@lo:400:kworker.0 Request processed in 49us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395049.557792:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787395049.557805:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787395049.557810:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323416832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.557836:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323416832:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395049.557842:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787395049.557851:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787395049.557856:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323416960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.557862:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787395049.557873:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323417344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.557899:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323416960:12345-0@lo:400:kworker.0 Request processed in 41us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395049.557905:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787395049.557921:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323417344:12345-0@lo:400:kworker.0 Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00080000:0.0:1787395049.557923:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395049.557929:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395049.557940:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787395049.557960:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323416704:12345-0@lo:400:kworker.0 Request processed in 348us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395049.557969:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787395049.558067:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323416960:0@lo:400:kworker.0 00000100:00100000:0.0:1787395049.558078:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323416832:0@lo:400:kworker.0 00010000:00080000:0.0:1787395049.558099:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b3291a1500 x1874219323417344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395049.558110:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323417344:0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.558136:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323417088:0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.558153:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323416704:0@lo:400:kworker.0 00000100:00100000:1.0:1787395049.558169:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323417216:0@lo:400:kworker.0 00000001:00100000:1.0:1787395049.639550:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:1.0:1787395049.639559:0:6626:0:(genops.c:906:class_export_put()) final put ffffa0b20324c800/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:2.0:1787395049.639911:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b20324c800/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-OST0000 00000020:00000080:2.0:1787395049.640076:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b20324f800 for lustre-OST0000 00010000:00010000:2.0:1787395049.938566:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395050.066703:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787395050.069526:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323417472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395050.069606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395050.073819:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417472 00000100:00100000:3.0:1787395050.073832:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417472 00000100:00100000:3.0:1787395050.073891:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787395050.073900:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323417472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787395050.073933:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395050.074009:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323417472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (4404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395050.074014:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787395050.074806:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33633e300 x1874219323417472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395050.074829:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33633e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323417472:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787395050.642877:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787395050.962568:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787395051.119085:0:11704:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:37:30 (1787395050) 00010000:00010000:0.0:1787395051.987504:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395052.423877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395052.423917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395052.423956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395052.424152:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510208 00000100:00100000:1.0:1787395052.424162:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510208 00000100:00100000:1.0:1787395052.424245:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510080 00000100:00100000:1.0:1787395052.424249:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510080 00000100:00100000:1.0:1787395052.424272:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:1.0:1787395052.424281:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304510208:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395052.424465:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304510208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 183us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395052.424473:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:1.0:1787395052.424491:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787395052.424498:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304510080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395052.424526:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304510080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395052.424606:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00080000:0.0:1787395052.425020:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395052.425496:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304509952 00000100:00100000:3.0:1787395052.425504:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304509952 00000100:00100000:3.0:1787395052.425621:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 279 00000100:00100000:3.0:1787395052.425629:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304509952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395052.425688:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304509952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 60us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395052.425696:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 279 00000100:00100000:0.0:1787395052.746436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395052.751849:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510336 00000100:00100000:3.0:1787395052.751863:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510336 00000100:00100000:3.0:1787395052.752039:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:3.0:1787395052.752050:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+5:10213:x1874219304510336:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395052.752069:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395052.752093:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a81f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21c8 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.752277:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.752330:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.752343:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395052.752688:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787395052.752692:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395052.752994:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.753021:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a81f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c8 expref: 7 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.753038:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c8 expref: 6 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395052.753047:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395052.753050:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395052.753053:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c400, rc 0) 00000100:00100000:3.0:1787395052.753168:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+6:10213:x1874219304510336:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1119us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395052.753176:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1787395052.769183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395052.769364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510464 00000100:00100000:0.0:1787395052.769377:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510464 00000100:00100000:0.0:1787395052.769453:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:0.0:1787395052.769465:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:10214:x1874219304510464:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395052.769497:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395052.769540:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a81fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21cf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769629:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769646:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769684:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769704:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769712:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.769719:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770381:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770396:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770406:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395052.770508:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787395052.770513:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395052.770601:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770614:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770620:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770637:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770643:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395052.770647:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770656:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770671:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:0.0:1787395052.770675:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395052.770680:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770687:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770704:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770710:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770716:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770721:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395052.770724:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770741:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770750:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0b318946500) 00010000:00010000:0.0:1787395052.770752:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395052.770755:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770761:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a820c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770804:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a81fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21cf expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770819:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21cf expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395052.770826:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:0.0:1787395052.770828:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787395052.770831:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010800, rc 0) 00000100:00100000:0.0:1787395052.770929:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:10214:x1874219304510464:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1465us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395052.770940:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:1.0:1787395052.779159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395052.781635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510720 00000100:00100000:2.0:1787395052.781659:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510720 00000100:00100000:2.0:1787395052.782610:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:2.0:1787395052.782633:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:10214:x1874219304510720:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395052.782675:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395052.782709:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a821a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21d6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.782813:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.782831:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.782846:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.786983:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.787019:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.787033:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.787991:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a822f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.788648:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a822f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.788669:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a822f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395052.788683:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787395052.789395:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789407:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789414:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789619:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395052.789624:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789632:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789648:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:2.0:1787395052.789651:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395052.789655:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789661:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8221 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789676:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789683:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789698:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789703:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395052.789705:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789711:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789718:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395052.789721:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395052.789725:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.789732:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8228 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.790206:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a821a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21d6 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.790222:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a822f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21d6 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395052.790239:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:2.0:1787395052.790241:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395052.790244:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49c00, rc 0) 00000100:00100000:2.0:1787395052.790350:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:10214:x1874219304510720:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 7726us (11207us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787395052.790369:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:2.0:1787395052.803180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395052.803390:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510848 00000100:00100000:3.0:1787395052.803403:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510848 00000100:00100000:3.0:1787395052.803477:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:3.0:1787395052.803489:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+9:10214:x1874219304510848:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787395052.803980:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+9:10214:x1874219304510848:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 Request processed in 491us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395052.804008:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00010000:00010000:2.0:1787395053.015395:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395053.715877:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787395054.034416:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395054.164186:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3367bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323417600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395054.164261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.164837:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417600 00000100:00100000:2.0:1787395054.164848:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417600 00000100:00100000:2.0:1787395054.164903:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787395054.164913:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323417600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395054.164946:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395054.166890:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323417600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1972us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.166903:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1787395054.167583:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395054.167639:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3367bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323417600:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1787395054.210874:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:2.0:1787395054.694520:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323417728:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.694590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.694892:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34101bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323417856:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.694924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.694946:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787395054.694952:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323417984:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.694973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.695002:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417856 00000100:00100000:2.0:1787395054.695008:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417856 00000100:00100000:2.0:1787395054.695047:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417984 00000100:00100000:2.0:1787395054.695050:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417984 00000100:00100000:2.0:1787395054.695089:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787395054.695097:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323417856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695145:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323417856:12345-0@lo:400:kworker.0 Request processed in 48us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.695158:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787395054.695193:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787395054.695199:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323417984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695227:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323417984:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.695233:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1787395054.695254:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395054.695279:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34101aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323417984:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695289:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34101bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323417856:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695328:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323418240:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.695372:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787395054.695377:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395054.695421:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323418240 00000100:00100000:2.0:1787395054.695424:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323418240 00000100:00100000:2.0:1787395054.695455:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787395054.695463:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323418240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695494:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323418240:12345-0@lo:400:kworker.0 Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.695500:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787395054.695516:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323418112 00000100:00100000:2.0:1787395054.695518:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323418112 00000100:00100000:2.0:1787395054.695541:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787395054.695547:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323418112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395054.695581:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323418112:12345-0@lo:400:kworker.0 Request processed in 34us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.695586:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1787395054.695603:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787395054.695606:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395054.695621:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341018380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323418112:0@lo:400:kworker.0 00010000:00080000:2.0:1787395054.695632:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b34101a300 x1874219323418240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787395070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395054.695641:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34101a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323418240:0@lo:400:kworker.0 00000100:00100000:3.0:1787395054.696052:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323417728 00000100:00100000:3.0:1787395054.696058:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323417728 00000100:00100000:3.0:1787395054.696095:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787395054.696103:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323417728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395054.696149:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323417728:12345-0@lo:400:kworker.0 Request processed in 47us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395054.696155:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787395054.696209:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323417728:0@lo:400:kworker.0 00000100:00100000:1.0:1787395054.784868:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395054.786497:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304510976 00000100:00100000:2.0:1787395054.786510:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304510976 00000100:00100000:2.0:1787395054.786584:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:2.0:1787395054.786594:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:10257:x1874219304510976:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395054.786613:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395054.786632:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a823d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21dd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786693:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786708:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786732:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786747:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786761:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.786768:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787018:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787026:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787033:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787039:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.787043:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395054.787046:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787395054.787051:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787063:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395054.787066:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.787071:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787077:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787087:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787098:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787104:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787109:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.787112:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787119:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787127:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395054.787129:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.787133:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787139:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a824b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787187:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a823d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21dd expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787196:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395054.787199:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.787202:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a823d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21dd expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.787209:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:2.0:1787395054.787295:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:10257:x1874219304510976:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 703us (2436us total) trans 0 rc 301/301 00000100:00100000:2.0:1787395054.787303:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:2.0:1787395054.810053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395054.812871:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304511232 00000100:00100000:0.0:1787395054.812887:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304511232 00000100:00100000:2.0:1787395054.813030:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1787395054.813042:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:10257:x1874219304511232:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:2.0:1787395054.813110:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395054.813137:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a81f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c8 expref: 8 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813153:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395054.813163:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395054.813478:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813493:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813503:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813516:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813523:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.813530:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395054.814574:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787395054.814587:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814596:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814603:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814609:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.814614:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814621:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814635:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3112e7300) 00010000:00010000:2.0:1787395054.814638:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.814642:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.814648:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8252 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395054.814667:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eeab1d16 reply state 00000000eee6e790 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395054.814676:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395054.814785:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:10257:x1874219304511232:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 1742us (4738us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787395054.814803:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00010000:00010000:0.0:1787395054.824444:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824464:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824483:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824490:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395054.824496:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824504:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824525:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0b3112e7d00) 00010000:00010000:0.0:1787395054.824529:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395054.824535:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395054.824541:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8259 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395054.923184:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395054.923343:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304511360 00000100:00100000:3.0:1787395054.923354:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304511360 00000100:00100000:3.0:1787395054.923526:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1787395054.923537:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+8:10265:x1874219304511360:12345-192.168.203.16@tcp:101:lctl.0 00010000:00010000:3.0:1787395054.923561:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395054.923585:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21e4 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923650:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923664:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923674:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395054.923750:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787395054.923754:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395054.923793:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923817:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21e4 expref: 10 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923852:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21e4 expref: 9 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395054.923861:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:3.0:1787395054.923864:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395054.923867:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d600, rc 0) 00000100:00100000:3.0:1787395054.923966:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+9:10265:x1874219304511360:12345-192.168.203.16@tcp:101:lctl.0 Request processed in 432us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395054.923974:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1787395054.969495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395054.969559:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304511488 00000100:00100000:2.0:1787395054.969569:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304511488 00000100:00100000:2.0:1787395054.969630:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:2.0:1787395054.969640:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:10271:x1874219304511488:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395054.969662:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395054.969682:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a826e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21eb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969746:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969761:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969771:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969785:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969792:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969798:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969899:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969918:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.969925:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395054.969958:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787395054.969962:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395054.969998:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970010:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970016:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970022:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970028:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.970032:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970039:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970050:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:2.0:1787395054.970053:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.970056:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970071:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970085:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970091:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970097:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970102:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.970105:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970111:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970118:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa0b3112e7300) 00010000:00010000:2.0:1787395054.970120:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.970122:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970128:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a827c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970157:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a826e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21eb expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970180:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21eb expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.970193:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395054.970195:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787395054.970198:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48c00, rc 0) 00000100:00100000:2.0:1787395054.970258:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+10:10271:x1874219304511488:12345-192.168.203.16@tcp:101:bash.0 Request processed in 619us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395054.970266:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:1.0:1787395054.979946:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395054.980041:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304511744 00000100:00100000:2.0:1787395054.980051:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304511744 00000100:00100000:2.0:1787395054.980113:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:2.0:1787395054.980123:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+10:10271:x1874219304511744:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395054.980142:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395054.980162:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a828a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21f2 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980349:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980365:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980377:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980426:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980434:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.980459:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787395054.980993:0:6624:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787395054.981158:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981179:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981188:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981220:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981227:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981233:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981238:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.981242:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981249:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981259:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395054.981261:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.981271:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981277:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8291 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395054.981289:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5e25ee1 reply state 00000000734b21e4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395054.981296:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787395054.981383:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a828a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 13 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981398:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 12 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.981405:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:2.0:1787395054.981408:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395054.981410:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395054.981480:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+13:10271:x1874219304511744:12345-192.168.203.16@tcp:101:bash.0 Request processed in 1359us (1543us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787395054.981489:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00010000:00010000:2.0:1787395054.986520:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986545:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986555:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986583:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395054.986588:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986595:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986615:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b3112e7300) 00010000:00010000:2.0:1787395054.986618:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395054.986622:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395054.986628:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395054.990500:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395054.990719:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304511872 00000100:00100000:3.0:1787395054.990730:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304511872 00000100:00100000:3.0:1787395054.990777:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:3.0:1787395054.990785:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2362:x1874219304511872:12345-192.168.203.16@tcp:8:bash.0 00010000:00080000:3.0:1787395054.990817:0:6601:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:3.0:1787395054.990849:0:6601:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a82ad 00002000:00100000:3.0:1787395054.990860:0:6601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cada4208-c1d6-4319-a546-8bfc38316f45/ffffa0b339220800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787395054.990885:0:6601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787395054.991123:0:6601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787395054.991151:0:6601:0:(import.c:65:import_set_state_nolock()) ffffa0b339226800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787395054.991233:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304511872:12345-192.168.203.16@tcp:8:bash.0 Request processed in 447us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395054.991242:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:0.0:1787395055.002386:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395055.002480:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304512000 00000100:00100000:2.0:1787395055.002490:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304512000 00000100:00100000:2.0:1787395055.002566:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:2.0:1787395055.002580:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:0:x1874219304512000:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395055.002600:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395055.002624:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc21f9 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395055.002656:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395055.002678:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1787395055.002682:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395055.002691:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.002732:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.002744:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:2.0:1787395055.002807:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:0:x1874219304512000:12345-192.168.203.16@tcp:101:bash.0 Request processed in 232us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395055.002814:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00080000:1.0:1787395055.003235:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395055.005902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.005988:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304512128 00000100:00100000:3.0:1787395055.005998:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304512128 00000100:00100000:3.0:1787395055.006070:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:3.0:1787395055.006081:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:10271:x1874219304512128:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395055.006101:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395055.006133:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2200 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.006167:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.006187:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395055.006191:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395055.006197:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.006233:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.006247:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395055.006290:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323418368:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395055.006425:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3080ae9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395055.012577:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323418368:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395055.012613:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.012635:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395055.012697:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:10271:x1874219304512128:12345-192.168.203.16@tcp:101:bash.0 Request processed in 6617us (6805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395055.012706:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:0.0:1787395055.014848:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395055.014934:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304512256 00000100:00100000:2.0:1787395055.014944:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304512256 00010000:00010000:2.0:1787395055.014984:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395055.015128:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:2.0:1787395055.015139:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304512256:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395055.015153:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395055.015183:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.015207:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.015240:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a82b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f9 expref: 8 pid: 6599 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.015276:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395055.015280:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395055.015289:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.015299:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.015357:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395055.015371:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5789:1874219323418496:192.168.203.16@tcp:105: 00000100:00100000:2.0:1787395055.015456:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202ce70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395055.017970:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5789:1874219323418496:192.168.203.16@tcp:105: 00010000:00010000:2.0:1787395055.017994:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395055.018051:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304512256:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2913us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395055.018062:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:0.0:1787395055.020057:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.020156:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304512512 00000100:00100000:3.0:1787395055.020166:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304512512 00000100:00100000:3.0:1787395055.020239:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1787395055.020251:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:10271:x1874219304512512:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:3.0:1787395055.020741:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+13:10271:x1874219304512512:12345-192.168.203.16@tcp:35:bash.0 Request processed in 491us (689us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787395055.020750:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00010000:00010000:0.0:1787395055.059260:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395055.090072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.090301:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304512768 00000100:00100000:3.0:1787395055.090454:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304512768 00000100:00100000:3.0:1787395055.090597:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:3.0:1787395055.090607:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+13:10281:x1874219304512768:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395055.090630:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395055.090650:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a82c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2207 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395055.090774:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787395055.090890:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a82c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2207 expref: 15 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.090905:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:3.0:1787395055.090908:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787395055.090913:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a82c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2207 expref: 15 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.090927:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787395055.090987:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+14:10281:x1874219304512768:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 382us (983us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787395055.090994:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:1.0:1787395055.093464:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.093721:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513024 00000100:00100000:3.0:1787395055.093731:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513024 00000100:00100000:3.0:1787395055.093783:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:3.0:1787395055.093792:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:10281:x1874219304513024:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395055.094282:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+15:10281:x1874219304513024:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 488us (824us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787395055.094292:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395055.187590:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323418624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395055.187679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395055.187917:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323418624 00000100:00100000:0.0:1787395055.187926:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323418624 00000100:00100000:0.0:1787395055.187979:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787395055.187989:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323418624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395055.188023:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395055.188075:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323418624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.188082:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787395055.188407:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323418624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395055.189148:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395055.189274:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513152 00000100:00100000:2.0:1787395055.189280:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513152 00000100:00100000:2.0:1787395055.189348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:2.0:1787395055.189358:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:10287:x1874219304513152:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395055.189401:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395055.189422:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a82d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc220e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189494:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189507:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189517:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395055.189576:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787395055.189580:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395055.189600:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189625:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a82d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc220e expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189642:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc220e expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.189651:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395055.189666:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395055.189670:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48200, rc 0) 00000100:00100000:2.0:1787395055.189722:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:10287:x1874219304513152:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 365us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395055.189729:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:0.0:1787395055.198362:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395055.198447:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513408 00000100:00100000:1.0:1787395055.198457:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513408 00000100:00100000:1.0:1787395055.198523:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:1.0:1787395055.198534:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+16:10287:x1874219304513408:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395055.198555:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395055.198574:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a82de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2215 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.198670:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a82e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.198683:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.198694:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395055.198706:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787395055.198820:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a82de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2215 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.198837:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a82e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2215 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.198862:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:1.0:1787395055.198865:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395055.198869:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030a00, rc 0) 00000100:00100000:1.0:1787395055.198924:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+18:10287:x1874219304513408:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 393us (574us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787395055.198932:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:1.0:1787395055.204837:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395055.204867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.204921:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513792 00000100:00100000:3.0:1787395055.204929:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513792 00000100:00100000:3.0:1787395055.204991:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:3.0:1787395055.205005:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+18:2363:x1874219304513792:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395055.205020:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395055.205058:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a82e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2215 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.205077:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:3.0:1787395055.205082:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395055.205153:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+17:2363:x1874219304513792:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 149us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395055.205161:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:2.0:1787395055.206433:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513664 00000100:00100000:2.0:1787395055.206441:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513664 00000100:00100000:2.0:1787395055.206500:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:2.0:1787395055.206509:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+17:10287:x1874219304513664:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395055.206531:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395055.206548:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a82f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc221c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.206627:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.206639:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.206648:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395055.206668:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787395055.206768:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a82f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc221c expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.206783:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc221c expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.206791:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:2.0:1787395055.206794:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787395055.206797:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787395055.206847:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+19:10287:x1874219304513664:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 340us (2026us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787395055.206866:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:1.0:1787395055.228593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395055.228742:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304513920 00000100:00100000:2.0:1787395055.228751:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304513920 00000100:00100000:2.0:1787395055.228810:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:2.0:1787395055.228820:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304513920:12345-192.168.203.16@tcp:1:lfs.0 00010000:00010000:2.0:1787395055.228867:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.228886:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.228895:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787395055.228899:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395055.228903:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.228964:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.228977:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 7 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395055.228992:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874219323418752:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395055.229097:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202ce70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395055.232637:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6599:1874219323418752:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395055.232682:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395055.240871:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.241009:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514048 00000100:00100000:0.0:1787395055.241020:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514048 00002000:00100000:0.0:1787395055.241064:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffffa0b34101a680 x1874219304514048/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:516/0 lens 504/0 e 0 to 0 dl 1787395066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395055.241075:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34101a680 with x1874219304514048 ext(0->12) 00010000:00010000:0.0:1787395055.241083:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 8 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.241100:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 8 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395055.241108:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b34101a680 00000100:00100000:0.0:1787395055.241144:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1787395055.241154:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304514048:12345-192.168.203.16@tcp:4:lfs.0 00000001:00100000:0.0:1787395055.283965:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000100:00100000:3.0:1787395055.284772:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304514048:12345-192.168.203.16@tcp:4:lfs.0 Request processed in 43613us (43905us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787395055.284791:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00002000:00100000:3.0:1787395055.284804:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffffa0b34101a680 x1874219304514048/t4294967299(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:516/0 lens 504/448 e 0 to 0 dl 1787395066 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787395055.284814:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34101a680 with x1874219304514048 ext(0->12) 00010000:00010000:3.0:1787395055.284824:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.284844:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787395055.284852:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b34101a680 00000100:00100000:1.0:1787395055.287513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.287600:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514176 00000100:00100000:3.0:1787395055.287609:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514176 00010000:00010000:3.0:1787395055.287645:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395055.287687:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1787395055.287710:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2365:x1874219304514176:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395055.287724:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787395055.287742:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787395055.287745:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787395055 00002000:00010000:3.0:1787395055.287747:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787395055 00002000:00010000:3.0:1787395055.287749:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787395055 00010000:00010000:3.0:1787395055.287755:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.287769:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.287791:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069a54d50/0xedbabbe2e89a82bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2200 expref: 9 pid: 6601 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.287807:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395055.287812:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395055.287818:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.287828:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.287866:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395055.287920:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2365:x1874219304514176:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 211us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395055.287927:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00010000:00010000:0.0:1787395055.288416:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288428:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288451:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288459:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288467:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288474:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395055.288479:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288487:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288503:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.288511:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8308 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.288588:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304513920:12345-192.168.203.16@tcp:1:lfs.0 Request processed in 59768us (60456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.288596:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:1.0:1787395055.291439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.291525:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514432 00000100:00100000:0.0:1787395055.291535:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514432 00000100:00100000:0.0:1787395055.291763:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395055.291774:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10287:x1874219304514432:12345-192.168.203.16@tcp:35:lfs.0 00000004:00010000:0.0:1787395055.291842:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc221c expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395055.292154:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787395055.292225:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787395055.292877:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787395055.292936:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.292953:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 23 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.292962:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.293000:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 23 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.293016:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 23 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.293043:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323418880:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395055.293144:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b339601600 going to sleep for 11 seconds 00000100:00100000:1.0:1787395055.298957:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.299450:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323418880:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395055.299477:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395055.299705:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514560 00000100:00100000:3.0:1787395055.299712:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514560 00010000:00010000:3.0:1787395055.299751:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 24 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395055.299833:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:3.0:1787395055.299843:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+24:2363:x1874219304514560:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395055.299858:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395055.299866:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 24 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299879:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 24 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299904:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a829f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21f2 expref: 24 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299918:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:3.0:1787395055.299923:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299932:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299940:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.299969:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395055.300039:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+23:2363:x1874219304514560:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 197us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395055.300062:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00010000:00010000:1.0:1787395055.300333:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.300342:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395055.300469:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787395055.300685:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787395055.300807:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323419008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787395055.300861:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395055.300939:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3413640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395055.301980:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323419008 00000100:00100000:2.0:1787395055.301989:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323419008 00000100:00100000:2.0:1787395055.302071:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787395055.302080:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323419008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787395055.302203:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323419008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395055.302211:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395055.302283:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323419008:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787395055.302949:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787395055.303028:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323419136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787395055.303068:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395055.303382:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b341364c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395055.303463:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323419136 00000100:00100000:3.0:1787395055.303471:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323419136 00000100:00100000:3.0:1787395055.303499:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787395055.303507:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323419136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787395055.303703:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1874219323419136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 196us (634us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787395055.303710:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787395055.303800:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341018700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323419136:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787395055.303851:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787395055.303889:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303900:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303908:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303914:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395055.303918:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303926:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303942:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:1.0:1787395055.303946:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787395055.303949:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.303955:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a830f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395055.304108:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787395055.304555:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787395055.304578:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327253271249ns, next at 328253269167ns, rc = 0 00000001:00080000:1.0:1787395055.304586:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787395055.304620:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7200) 00010000:00010000:1.0:1787395055.304624:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787395055.304631:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a82fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc221c expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395055.304784:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+26:10287:x1874219304514432:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 13011us (13480us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787395055.304793:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000020:00080000:1.0:1787395055.304798:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787395055.307518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.307608:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514688 00000100:00100000:0.0:1787395055.307618:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514688 00000100:00100000:0.0:1787395055.307697:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:0.0:1787395055.307707:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+26:10287:x1874219304514688:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395055.307731:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395055.307753:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8316 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2223 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.307809:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2223 expref: 27 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.307823:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8316 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2223 expref: 27 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.307841:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.307844:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787395055.307848:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011c00, rc 0) 00000100:00100000:0.0:1787395055.307906:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+27:10287:x1874219304514688:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 200us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.307927:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:2.0:1787395055.310262:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.310387:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304514944 00000100:00100000:3.0:1787395055.310396:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304514944 00000100:00100000:3.0:1787395055.310440:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:3.0:1787395055.310448:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b310801450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+27:10287:x1874219304514944:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395055.310651:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b310801450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+28:10287:x1874219304514944:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 203us (396us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787395055.310658:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1787395055.417953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.418240:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304515200 00000100:00100000:3.0:1787395055.418252:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304515200 00000100:00100000:3.0:1787395055.418386:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:3.0:1787395055.418397:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+28:10297:x1874219304515200:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395055.418425:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395055.418491:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a831d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc222a expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395055.418608:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787395055.418719:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a831d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc222a expref: 30 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.418734:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:0.0:1787395055.418737:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395055.418742:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a831d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc222a expref: 30 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.418755:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010c00, rc 0) 00000100:00100000:0.0:1787395055.418822:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:10297:x1874219304515200:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 427us (878us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1787395055.418830:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:3.0:1787395055.422651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.422696:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304515328 00000100:00100000:0.0:1787395055.422705:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304515328 00000100:00100000:0.0:1787395055.422807:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:0.0:1787395055.422817:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+29:10297:x1874219304515328:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395055.422887:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.422902:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.422915:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.422945:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.422953:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.422960:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423053:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423061:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423068:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395055.423106:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423118:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423124:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423131:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423137:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.423141:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423154:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423180:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395055.423183:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395055.423188:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423195:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a832b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423209:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423213:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423218:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423223:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.423225:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423230:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423237:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946f00) 00010000:00010000:0.0:1787395055.423239:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395055.423242:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423257:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423271:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423277:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423282:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423286:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.423289:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423295:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423302:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.423351:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395055.423355:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.423361:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.423436:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+29:10297:x1874219304515328:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 619us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.423444:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:1.0:1787395055.426658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.427424:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304515584 00000100:00100000:3.0:1787395055.427435:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304515584 00000100:00100000:3.0:1787395055.427497:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:3.0:1787395055.427508:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:10297:x1874219304515584:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395055.427767:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+30:10297:x1874219304515584:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 260us (1118us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787395055.427775:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395055.489883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.489988:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304515840 00000100:00100000:0.0:1787395055.489999:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304515840 00000100:00100000:0.0:1787395055.490055:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:0.0:1787395055.490065:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+30:10300:x1874219304515840:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395055.490090:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395055.490110:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2231 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490204:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490219:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490230:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490254:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490262:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490269:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490805:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490814:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490840:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395055.490851:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787395055.490947:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490955:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490961:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490966:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.490970:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490977:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.490989:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395055.490992:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395055.490996:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491001:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8347 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491014:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491020:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491032:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491037:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.491040:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491046:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491054:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946f00) 00010000:00010000:0.0:1787395055.491057:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395055.491060:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491066:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a834e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491109:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 33 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491639:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 32 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.491648:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.491650:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395055.491653:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010c00, rc 0) 00000100:00100000:0.0:1787395055.491721:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+32:10300:x1874219304515840:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1657us (1846us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787395055.491740:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:1.0:1787395055.499816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.499890:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304515968 00000100:00100000:0.0:1787395055.499900:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304515968 00000100:00100000:0.0:1787395055.499966:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:0.0:1787395055.499976:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:10300:x1874219304515968:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:0.0:1787395055.500044:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500061:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500072:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500098:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500106:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500112:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500117:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395055.500122:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500129:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500139:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.500155:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395055.500160:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.500176:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8363 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.500263:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:10300:x1874219304515968:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 288us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.500272:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:1.0:1787395055.503390:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.503466:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304516224 00000100:00100000:3.0:1787395055.503475:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304516224 00000100:00100000:3.0:1787395055.503531:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1787395055.503541:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+32:10300:x1874219304516224:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395055.504066:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:10300:x1874219304516224:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 525us (683us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787395055.504074:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:2.0:1787395055.704617:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.705127:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304516480 00000100:00100000:0.0:1787395055.705138:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304516480 00000100:00100000:0.0:1787395055.705210:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:0.0:1787395055.705220:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+33:10331:x1874219304516480:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:0.0:1787395055.705254:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395055.705277:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a836a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2238 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.705416:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8371 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.705431:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.705442:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8371 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395055.705464:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787395055.705605:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a836a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2238 expref: 36 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.705644:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8371 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2238 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.705652:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.705655:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395055.705659:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010400, rc 0) 00000100:00100000:0.0:1787395055.705731:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:10331:x1874219304516480:12345-192.168.203.16@tcp:101:cat.0 Request processed in 511us (1132us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787395055.705738:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:1.0:1787395055.714067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395055.714175:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304516608 00000100:00100000:3.0:1787395055.714184:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304516608 00000100:00100000:3.0:1787395055.714255:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:3.0:1787395055.714265:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+35:2366:x1874219304516608:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395055.714279:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395055.714301:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8371 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2238 expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395055.714353:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:3.0:1787395055.714358:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395055.714413:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:2366:x1874219304516608:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 149us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395055.714421:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787395055.722571:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395055.722758:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304516864 00000100:00100000:2.0:1787395055.722768:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304516864 00000100:00100000:2.0:1787395055.722829:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395055.722839:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+34:10331:x1874219304516864:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:2.0:1787395055.723508:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:10331:x1874219304516864:12345-192.168.203.16@tcp:35:cat.0 Request processed in 662us (945us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787395055.723522:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395055.822579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.822840:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304517120 00000100:00100000:0.0:1787395055.822852:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304517120 00000100:00100000:0.0:1787395055.822925:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:0.0:1787395055.822936:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+35:10337:x1874219304517120:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1787395055.822958:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395055.822961:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787395055.822984:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a82d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc220e expref: 35 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823002:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395055.823007:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395055.823207:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a837f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc223f expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823361:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823393:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 35 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823401:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823432:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 35 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.823446:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 35 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.823459:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323419264:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395055.823664:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b339601240 going to sleep for 11 seconds 00000100:00100000:0.0:1787395055.829159:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323419264:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395055.829199:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395055.829978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395055.830900:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304517248 00000100:00100000:0.0:1787395055.830911:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304517248 00010000:00010000:0.0:1787395055.830950:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 36 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395055.830992:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:0.0:1787395055.831010:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:2363:x1874219304517248:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395055.831025:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395055.831043:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 36 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831055:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 36 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831078:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a8355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2231 expref: 36 pid: 6624 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831094:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395055.831099:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831108:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831115:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395055.831451:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395055.831727:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.831735:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395055.831763:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787395055.831926:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a837f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 37 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.831943:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 36 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.831950:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395055.831953:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395055.831955:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010600, rc 0) 00000100:00100000:0.0:1787395055.832032:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:2363:x1874219304517248:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 508us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395055.832043:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:2.0:1787395055.832093:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+35:10337:x1874219304517120:12345-192.168.203.16@tcp:101:dd.0 Request processed in 9159us (9526us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787395055.832100:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395055.848098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395055.848740:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304517504 00000100:00100000:1.0:1787395055.848751:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304517504 00000100:00100000:1.0:1787395055.848914:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:1.0:1787395055.848924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+35:10337:x1874219304517504:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1787395055.849222:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.849240:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395055.849252:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395055.849360:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787395055.849383:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ed5cd5f reply state 00000000dd9b386a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395055.849391:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395055.849496:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+38:10337:x1874219304517504:12345-192.168.203.16@tcp:36:dd.0 Request processed in 574us (1407us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787395055.849503:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000020:00080000:1.0:1787395055.849508:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395055.853236:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853255:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853262:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853268:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395055.853273:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853281:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853353:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395055.853357:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395055.853361:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395055.853366:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a8394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.082638:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395056.117926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395056.118360:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304517632 00000100:00100000:3.0:1787395056.118381:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304517632 00000100:00100000:3.0:1787395056.118447:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:3.0:1787395056.118471:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+37:10351:x1874219304517632:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:3.0:1787395056.118494:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395056.118513:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a839b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2246 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118575:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118588:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118601:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395056.118606:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787395056.118618:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118627:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118635:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118726:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118737:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 38 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118744:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118784:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 38 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.118798:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 38 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395056.118813:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323419392:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395056.118903:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395056.122856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.122972:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323419392:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395056.122997:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395056.123047:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304517888 00000100:00100000:1.0:1787395056.123068:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304517888 00000100:00100000:1.0:1787395056.123133:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1787395056.123145:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+39:5577:x1874219304517888:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787395056.123757:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+40:5577:x1874219304517888:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 611us (907us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787395056.123766:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787395056.126757:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.126860:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304518016 00000100:00100000:0.0:1787395056.126870:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304518016 00010000:00010000:0.0:1787395056.126922:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 40 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.126960:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:0.0:1787395056.126970:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+40:2363:x1874219304518016:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395056.126997:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395056.127013:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 40 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127027:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 40 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127049:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8386 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc223f expref: 40 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127066:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.127070:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127080:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127088:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.127126:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395056.127194:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+39:2363:x1874219304518016:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 225us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395056.127202:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00010000:00010000:2.0:1787395056.127542:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127551:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395056.127596:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787395056.127601:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395056.127638:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127650:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127659:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127674:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127680:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127686:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.127691:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127699:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127710:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395056.127713:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.127717:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127724:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a83a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127735:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127741:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127747:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127752:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.127761:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127767:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127776:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395056.127778:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.127781:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127786:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a83a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127824:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a839b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2246 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127837:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2246 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.127844:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.127846:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395056.127849:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:2.0:1787395056.127893:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+38:10351:x1874219304517632:12345-192.168.203.16@tcp:101:stat.0 Request processed in 9424us (9976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395056.127918:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:2.0:1787395056.227749:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.227843:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304518272 00000100:00100000:0.0:1787395056.227855:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304518272 00000100:00100000:0.0:1787395056.227926:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787395056.227936:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+38:10357:x1874219304518272:12345-192.168.203.16@tcp:36:truncate.0 00010000:00010000:0.0:1787395056.228020:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395056.228048:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a83b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2246 expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.228068:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.228074:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395056.228289:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.228303:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.228456:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395056.228508:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1787395056.228532:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000090c732d3 reply state 00000000192548d9 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.228541:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395056.228702:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+40:10357:x1874219304518272:12345-192.168.203.16@tcp:36:truncate.0 Request processed in 766us (962us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787395056.228710:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000020:00080000:0.0:1787395056.228717:0:6624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395056.233385:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233423:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233431:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233437:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.233442:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233450:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233469:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.233472:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.233477:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.233482:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a83b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395056.420338:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395056.420437:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304518400 00000100:00100000:1.0:1787395056.420447:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304518400 00000100:00100000:1.0:1787395056.420496:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787395056.420506:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+39:10371:x1874219304518400:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:1.0:1787395056.420531:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395056.420551:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a83be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc224d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420617:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420644:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420656:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420673:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420679:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420684:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420805:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420814:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420821:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395056.420856:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787395056.420861:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395056.420883:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420894:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420924:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420930:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420936:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420941:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395056.420945:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420952:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420963:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395056.420966:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395056.420970:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420976:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a83c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420989:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.420995:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421001:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421012:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395056.421015:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421020:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421029:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318517600) 00010000:00010000:1.0:1787395056.421031:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395056.421034:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421041:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a83cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421074:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a83be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 41 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421087:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 40 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395056.421094:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:1.0:1787395056.421096:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395056.421099:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030a00, rc 0) 00000100:00100000:1.0:1787395056.421152:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+40:10371:x1874219304518400:12345-192.168.203.16@tcp:101:stat.0 Request processed in 647us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395056.421169:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787395056.544616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.548724:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304518656 00000100:00100000:2.0:1787395056.548741:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304518656 00000100:00100000:2.0:1787395056.548820:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:2.0:1787395056.548831:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+40:10381:x1874219304518656:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395056.548854:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395056.548874:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a83da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2254 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395056.549191:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787395056.549324:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a83da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2254 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.549340:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:2.0:1787395056.549343:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395056.549348:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a83da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2254 expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.549363:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49200, rc 0) 00000100:00100000:2.0:1787395056.549555:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+41:10381:x1874219304518656:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 724us (4948us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787395056.549563:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787395056.556633:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.556727:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304518912 00000100:00100000:2.0:1787395056.556737:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304518912 00000100:00100000:2.0:1787395056.556846:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:2.0:1787395056.556856:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+41:10381:x1874219304518912:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395056.557132:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+42:10381:x1874219304518912:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 277us (507us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787395056.557141:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1787395056.632867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.636845:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304519168 00000100:00100000:0.0:1787395056.636861:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304519168 00000100:00100000:0.0:1787395056.636931:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787395056.636942:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+42:10387:x1874219304519168:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395056.636966:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395056.637000:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc225b expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.637097:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.637110:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.637135:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.637179:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.637193:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 43 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.637207:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323419520:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395056.637330:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3396016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395056.640498:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323419520:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395056.640529:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395056.650524:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395056.651021:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304519296 00000100:00100000:3.0:1787395056.651030:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304519296 00010000:00010000:3.0:1787395056.651067:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 44 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395056.651106:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:3.0:1787395056.651266:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+44:2364:x1874219304519296:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395056.651282:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395056.651289:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 44 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651302:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 44 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651352:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a83d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc224d expref: 44 pid: 5802 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651381:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:3.0:1787395056.651386:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651394:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651400:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395056.651430:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395056.651492:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+43:2364:x1874219304519296:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 376us (975us total) trans 0 rc 0/0 00010000:00010000:0.0:1787395056.651496:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395056.651503:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00010000:00010000:0.0:1787395056.651511:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395056.651540:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787395056.651840:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 44 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.651868:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 43 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.651877:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.651880:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787395056.651882:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011200, rc 0) 00000100:00100000:0.0:1787395056.651911:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+43:10387:x1874219304519168:12345-192.168.203.16@tcp:101:bash.0 Request processed in 14971us (19054us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787395056.652291:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:3.0:1787395056.658826:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.659017:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304519552 00000100:00100000:0.0:1787395056.659028:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304519552 00000100:00100000:0.0:1787395056.659091:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:0.0:1787395056.659101:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+43:10387:x1874219304519552:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:0.0:1787395056.660328:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.660348:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.660360:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395056.660457:0:11555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787395056.660493:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000788c74e1 reply state 0000000061126433 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.660502:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395056.663850:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f440a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+46:10387:x1874219304519552:12345-192.168.203.16@tcp:36:bash.0 Request processed in 4740us (5024us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787395056.663863:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00000020:00080000:0.0:1787395056.663871:0:11555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395056.666428:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666444:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666472:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666478:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.666482:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666490:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666506:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.666510:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.666514:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.666520:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a83fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395056.673474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.673744:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304519680 00000100:00100000:2.0:1787395056.673753:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304519680 00000100:00100000:2.0:1787395056.673810:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:2.0:1787395056.673820:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+45:10387:x1874219304519680:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395056.673843:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395056.673863:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2262 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.673942:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.673956:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 46 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.673979:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.674011:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 46 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.674024:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 46 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395056.675283:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323419648:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395056.675556:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202ce7900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395056.678629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.679529:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304519808 00000100:00100000:0.0:1787395056.679540:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304519808 00010000:00010000:0.0:1787395056.679583:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 47 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.679629:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:0.0:1787395056.679639:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+47:2363:x1874219304519808:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395056.679653:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395056.679662:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 47 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.679676:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 47 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.679700:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.679706:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.679827:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.679835:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.679878:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395056.679940:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+47:2363:x1874219304519808:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 302us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395056.679948:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00010000:00010000:2.0:1787395056.683504:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a83ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc225b expref: 46 pid: 6624 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395056.683592:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff3ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323419648:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395056.683617:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.683627:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.683634:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395056.683688:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787395056.683693:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395056.684177:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.684231:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2262 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.684247:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2262 expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.684256:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.684259:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395056.684262:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49400, rc 0) 00000100:00100000:2.0:1787395056.684686:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+45:10387:x1874219304519680:12345-192.168.203.16@tcp:101:bash.0 Request processed in 10865us (11219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395056.684695:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:1.0:1787395056.688475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395056.688554:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304520064 00000100:00100000:3.0:1787395056.688564:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304520064 00000100:00100000:3.0:1787395056.688612:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787395056.688622:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+45:10387:x1874219304520064:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:3.0:1787395056.688865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+46:10387:x1874219304520064:12345-192.168.203.16@tcp:35:bash.0 Request processed in 236us (391us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787395056.688879:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:1.0:1787395056.771050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.771152:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304520320 00000100:00100000:2.0:1787395056.771171:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304520320 00000100:00100000:2.0:1787395056.771263:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:2.0:1787395056.771273:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+46:10397:x1874219304520320:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395056.771295:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395056.771342:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8412 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2269 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395056.771961:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787395056.772265:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8412 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2269 expref: 48 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.772282:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:2.0:1787395056.772286:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395056.772468:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8412 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2269 expref: 48 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.772484:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49200, rc 0) 00000100:00100000:2.0:1787395056.772601:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+47:10397:x1874219304520320:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1328us (1611us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787395056.772610:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:1.0:1787395056.776102:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395056.776206:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304520448 00000100:00100000:0.0:1787395056.776216:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304520448 00000100:00100000:0.0:1787395056.776271:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:0.0:1787395056.776282:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+47:10397:x1874219304520448:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395056.777048:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777067:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777080:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777095:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777101:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777107:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777210:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777219:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777240:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395056.777278:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777289:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777294:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777301:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777335:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395056.777339:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777347:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777359:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395056.777362:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395056.777366:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777373:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8420 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777386:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777399:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777405:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777409:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395056.777412:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777419:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777427:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946f00) 00010000:00010000:0.0:1787395056.777430:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395056.777432:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777438:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777454:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777460:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777465:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777470:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395056.777478:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777484:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777492:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.777494:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395056.777497:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.777502:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a842e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395056.777583:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+47:10397:x1874219304520448:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1301us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395056.777592:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:1.0:1787395056.781397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395056.781500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304520704 00000100:00100000:3.0:1787395056.781509:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304520704 00000100:00100000:3.0:1787395056.781602:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787395056.781614:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+47:10397:x1874219304520704:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395056.781864:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+48:10397:x1874219304520704:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 251us (564us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1787395056.781871:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787395056.818660:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.823708:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304520960 00000100:00100000:2.0:1787395056.823723:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304520960 00000100:00100000:2.0:1787395056.823796:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:2.0:1787395056.823806:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+48:10400:x1874219304520960:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395056.823829:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395056.823851:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2270 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823927:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823940:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823951:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823964:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823971:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.823978:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824220:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a844a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824230:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a844a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824238:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a844a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395056.824247:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787395056.824441:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824448:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824455:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824461:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.824465:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824472:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824484:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395056.824487:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.824491:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824506:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a843c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824520:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824527:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824533:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824538:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.824542:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824547:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824555:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b3112e7c00) 00010000:00010000:2.0:1787395056.824557:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395056.824560:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824564:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824799:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2270 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824813:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a844a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2270 expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.824827:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.824830:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395056.824833:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395056.824974:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+50:10400:x1874219304520960:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1168us (6394us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787395056.824982:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:1.0:1787395056.829421:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.829467:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304521088 00000100:00100000:2.0:1787395056.829477:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304521088 00000100:00100000:2.0:1787395056.829535:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:2.0:1787395056.829546:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+50:10400:x1874219304521088:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:2.0:1787395056.829624:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829641:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829652:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829676:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829682:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829689:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829694:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395056.829712:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829720:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829732:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:2.0:1787395056.829736:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395056.829739:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395056.829744:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395056.829819:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+50:10400:x1874219304521088:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 275us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395056.829828:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:3.0:1787395056.831648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395056.835839:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395056.835916:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304521472 00000100:00100000:2.0:1787395056.835925:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304521472 00000100:00100000:2.0:1787395056.835980:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:2.0:1787395056.835991:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+50:10400:x1874219304521472:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395056.836245:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+51:10400:x1874219304521472:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 255us (413us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787395056.836253:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:0.0:1787395056.837663:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304521216 00000100:00100000:0.0:1787395056.837673:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304521216 00000100:00100000:0.0:1787395056.837854:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1787395056.837864:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+51:2363:x1874219304521216:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395056.837878:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395056.837901:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a844a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2270 expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395056.837919:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395056.837925:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395056.837991:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+50:2363:x1874219304521216:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 129us (6353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395056.838025:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:1.0:1787395057.049865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395057.049962:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304521728 00000100:00100000:0.0:1787395057.049972:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304521728 00000100:00100000:0.0:1787395057.050032:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:0.0:1787395057.050043:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+50:10418:x1874219304521728:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:0.0:1787395057.050065:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395057.050098:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a845f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2277 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.050228:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8466 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.050242:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.050253:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395057.050264:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787395057.050426:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a845f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2277 expref: 53 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.050444:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8466 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2277 expref: 52 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.050453:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:0.0:1787395057.050456:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787395057.050470:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011200, rc 0) 00000100:00100000:0.0:1787395057.050539:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+52:10418:x1874219304521728:12345-192.168.203.16@tcp:101:cat.0 Request processed in 499us (684us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787395057.050546:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:1.0:1787395057.098220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.098367:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304521856 00000100:00100000:3.0:1787395057.098381:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304521856 00000100:00100000:3.0:1787395057.098462:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395057.098473:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+52:10419:x1874219304521856:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395057.098505:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395057.098532:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8474 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc227e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098634:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098651:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098667:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395057.098746:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787395057.098751:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395057.098773:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098802:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8474 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc227e expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098849:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc227e expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.098860:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395057.098864:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395057.098869:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:3.0:1787395057.098957:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10419:x1874219304521856:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 486us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.098966:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:1.0:1787395057.105623:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.105739:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522240 00000100:00100000:2.0:1787395057.105752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522240 00000100:00100000:2.0:1787395057.105825:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:2.0:1787395057.105837:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10419:x1874219304522240:12345-192.168.203.16@tcp:35:lfs.0 00010000:00010000:3.0:1787395057.106739:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395057.107039:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+54:10419:x1874219304522240:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 1196us (1424us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787395057.107071:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787395057.109806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.110556:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522368 00000100:00100000:3.0:1787395057.110572:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522368 00000100:00100000:3.0:1787395057.110665:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:3.0:1787395057.110677:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+54:10419:x1874219304522368:12345-192.168.203.16@tcp:103:lfs.0 00010000:00010000:3.0:1787395057.110697:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787395057.110729:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a840b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2262 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.110757:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2277 expref: 53 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.110772:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8316 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2223 expref: 52 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.110782:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946e00) 00010000:00010000:3.0:1787395057.110814:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395057.110884:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+51:10419:x1874219304522368:12345-192.168.203.16@tcp:103:lfs.0 Request processed in 209us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.110893:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:1.0:1787395057.113686:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.114129:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522496 00000100:00100000:2.0:1787395057.114142:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522496 00000100:00100000:2.0:1787395057.114291:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:2.0:1787395057.114336:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+51:10419:x1874219304522496:12345-192.168.203.16@tcp:58:lfs.0 00010000:00010000:2.0:1787395057.114480:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.114501:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.114517:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395057.114917:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787395057.115199:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787395057.115278:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787395057.115456:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+51:10419:x1874219304522496:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 1150us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395057.115468:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:1.0:1787395057.138817:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.138931:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522624 00000100:00100000:2.0:1787395057.138944:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522624 00000100:00100000:2.0:1787395057.139030:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:2.0:1787395057.139044:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+51:10421:x1874219304522624:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395057.139072:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395057.139100:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2285 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139249:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139267:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139282:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139299:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139353:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139361:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139488:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139498:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139505:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395057.139812:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787395057.139818:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395057.139842:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139871:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139881:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139888:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139894:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139901:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395057.139906:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139914:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139929:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395057.139933:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395057.139938:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139945:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8490 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139960:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139966:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139978:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.139982:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395057.139995:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140003:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140010:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b3112e7f00) 00010000:00010000:2.0:1787395057.140013:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395057.140016:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140020:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a8497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140084:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140097:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.140104:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:2.0:1787395057.140106:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395057.140108:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49400, rc 0) 00000100:00100000:2.0:1787395057.140203:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+52:10421:x1874219304522624:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1160us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395057.140224:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:1.0:1787395057.538226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395057.538338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395057.538367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.539123:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523008 00000100:00100000:2.0:1787395057.539134:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523008 00000100:00080000:2.0:1787395057.539184:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395057.539241:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1787395057.539253:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304523008:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395057.539508:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:907adeaf-e431-466d-a504-1dc9d988b548+5:2366:x1874219304523008:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 257us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395057.539519:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:3.0:1787395057.542475:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522752 00000100:00100000:3.0:1787395057.542488:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522752 00000100:00100000:3.0:1787395057.542666:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 281 00000100:00100000:3.0:1787395057.542678:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304522752:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395057.542765:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304522752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 89us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.542773:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 281 00000100:00100000:0.0:1787395057.547055:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304522880 00000100:00100000:0.0:1787395057.547069:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304522880 00000100:00100000:0.0:1787395057.547264:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787395057.547281:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304522880:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395057.547548:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304522880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 273us (9330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395057.547556:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00080000:2.0:1787395057.549213:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787395057.810610:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395057.810620:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395057.810669:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787395057.810676:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395057.810799:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323419776:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395057.810886:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b339601cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395057.819957:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323419776:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787395057.822839:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.823193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523136 00000100:00100000:3.0:1787395057.823203:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523136 00000100:00100000:3.0:1787395057.823258:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:3.0:1787395057.823268:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523136:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787395057.823617:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523136:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 Request processed in 349us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.823625:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787395057.834598:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.834729:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523264 00000100:00100000:3.0:1787395057.834739:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523264 00000100:00100000:3.0:1787395057.834792:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:3.0:1787395057.834801:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523264:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787395057.834831:0:5802:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787395057.834941:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523264:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 140us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.834956:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:0.0:1787395057.839959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.840106:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523392 00000100:00100000:3.0:1787395057.840169:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523392 00000100:00100000:3.0:1787395057.840230:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:3.0:1787395057.840240:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523392:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787395057.840352:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840369:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840381:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840420:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840429:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840437:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840464:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840471:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840477:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395057.840525:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787395057.840530:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395057.840542:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840552:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840558:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840564:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840569:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395057.840573:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840801:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840817:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:3.0:1787395057.840820:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395057.840825:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840831:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a84a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840845:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840860:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840866:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840871:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395057.840874:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840880:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840887:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa0b308bf3600) 00010000:00010000:3.0:1787395057.840889:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395057.840892:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840897:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a84ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840911:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840917:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840923:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840927:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395057.840937:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840945:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840954:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:3.0:1787395057.840957:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395057.840960:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.840966:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395057.841047:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523392:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 806us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.841057:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:0.0:1787395057.847147:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395057.847368:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523648 00000100:00100000:1.0:1787395057.847378:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523648 00000100:00100000:1.0:1787395057.847428:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:1.0:1787395057.847439:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+52:10432:x1874219304523648:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395057.847458:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395057.847478:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a84ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc228c expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847575:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847667:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847679:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395057.847694:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787395057.847790:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847797:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847804:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847810:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395057.847814:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847822:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847834:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:1.0:1787395057.847837:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787395057.847841:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847848:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a84c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847889:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a84ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc228c expref: 54 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847905:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:1.0:1787395057.847907:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395057.847911:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a84ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc228c expref: 54 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395057.847921:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300031000, rc 0) 00000100:00100000:1.0:1787395057.847984:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304523648:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 547us (846us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787395057.848807:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:0.0:1787395057.852959:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.853136:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304523776 00000100:00100000:3.0:1787395057.853147:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304523776 00000100:00100000:3.0:1787395057.853219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:3.0:1787395057.853227:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304523776:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787395057.853273:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787395057.853400:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304523776:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 173us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.853409:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:0.0:1787395057.859739:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.860034:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524032 00000100:00100000:3.0:1787395057.860044:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524032 00000100:00100000:3.0:1787395057.860203:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:3.0:1787395057.860214:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304524032:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395057.860247:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395057.860251:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787395057.860279:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a847b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc227e expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.860297:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395057.860303:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395057.860343:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a84cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2293 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395057.860741:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787395057.860935:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.860948:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.860957:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.861009:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a84cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2293 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.861024:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2293 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.861030:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:3.0:1787395057.861032:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395057.861046:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395057.861205:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+54:10432:x1874219304524032:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 992us (1474us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787395057.861213:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:1.0:1787395057.875068:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.875521:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524288 00000100:00100000:2.0:1787395057.875531:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524288 00000100:00100000:2.0:1787395057.875586:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:2.0:1787395057.875596:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+54:10432:x1874219304524288:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787395057.875655:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395057.875681:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a84d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2293 expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875698:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:2.0:1787395057.875709:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395057.875730:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875743:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875763:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875782:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875789:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875796:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875886:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875895:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875902:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875908:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395057.875912:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875920:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875929:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395057.875933:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395057.875936:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875949:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a84e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875973:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875979:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875985:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.875990:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395057.875993:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.876000:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.876008:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x733c087d (ffffa0b3112e7f00) 00010000:00010000:2.0:1787395057.876011:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395057.876014:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395057.876020:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a84eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x733c087d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395057.876112:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304524288:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 516us (1053us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787395057.876120:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:0.0:1787395057.878994:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395057.879034:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524416 00000100:00100000:0.0:1787395057.879043:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524416 00000100:00100000:0.0:1787395057.879101:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:0.0:1787395057.879121:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+53:10432:x1874219304524416:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395057.879141:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395057.879180:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a84f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc229a expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879214:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879226:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879238:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879354:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a84f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 55 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879372:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 54 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395057.879381:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:0.0:1787395057.879384:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787395057.879387:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011600, rc 0) 00000100:00100000:0.0:1787395057.879446:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+54:10432:x1874219304524416:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 337us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395057.879455:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:2.0:1787395057.887139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.887224:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524672 00000100:00100000:3.0:1787395057.887235:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524672 00000100:00100000:3.0:1787395057.887291:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:3.0:1787395057.887302:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+54:10432:x1874219304524672:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787395057.887399:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.887417:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.887429:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787395057.887777:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787395057.887787:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329836479713ns, next at 330836477276ns, rc = 0 00000004:00010000:3.0:1787395057.887867:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007877923c reply state 00000000fa042ce5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395057.887891:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395057.889171:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+56:10432:x1874219304524672:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 1864us (2034us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787395057.889181:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00010000:00010000:3.0:1787395057.896695:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896713:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896720:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896736:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395057.896740:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896749:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896765:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:3.0:1787395057.896768:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787395057.896771:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.896777:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8500 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395057.909866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395057.909934:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524800 00000100:00100000:3.0:1787395057.909943:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524800 00000100:00100000:3.0:1787395057.910014:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:3.0:1787395057.910024:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+55:10432:x1874219304524800:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395057.910046:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395057.910065:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22a1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.910122:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.910139:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395057.910186:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:3.0:1787395057.910190:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395057.910194:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787395057.910264:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+56:10432:x1874219304524800:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 241us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395057.910272:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:1.0:1787395057.915511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395057.922417:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304524928 00000100:00100000:2.0:1787395057.922431:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304524928 00000100:00100000:2.0:1787395057.922477:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787395057.922485:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304524928:12345-192.168.203.16@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787395057.922514:0:6602:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:2.0:1787395057.922545:0:6602:0:(genops.c:1406:class_connect()) connect: client cada4208-c1d6-4319-a546-8bfc38316f45, cookie 0xedbabbe2e89a850e 00002000:00100000:2.0:1787395057.922556:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cada4208-c1d6-4319-a546-8bfc38316f45/ffffa0b318c9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787395057.922578:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787395057.922875:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787395057.922908:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa0b318c98000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395057.923088:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2362:x1874219304524928:12345-192.168.203.16@tcp:8:lhsmtool_posix.0 Request processed in 602us (7587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395057.923097:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787395057.930925:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395057.932363:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304525056 00000100:00100000:1.0:1787395057.932375:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304525056 00000100:00100000:1.0:1787395057.932440:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:1.0:1787395057.932450:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:0:x1874219304525056:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787395057.932789:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787395057.954397:0:11854:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395057.954408:0:11854:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395057.954466:0:11854:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787395057.954472:0:11854:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787395058.012926:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:0:x1874219304525056:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 80465us (81999us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787395058.012940:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000001:00080000:3.0:1787395058.012976:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1787395058.013049:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000100:00100000:1.0:1787395058.024804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395058.024869:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304525312 00000100:00100000:3.0:1787395058.024880:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304525312 00000100:00100000:3.0:1787395058.024949:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787395058.024960:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+56:10432:x1874219304525312:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1787395058.025255:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395058.025449:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+57:10432:x1874219304525312:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 489us (654us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787395058.025458:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787395058.035400:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.035479:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304525568 00000100:00100000:0.0:1787395058.035488:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304525568 00000100:00100000:0.0:1787395058.035552:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395058.035563:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+57:10432:x1874219304525568:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787395058.035680:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+57:10432:x1874219304525568:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 118us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395058.035696:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:3.0:1787395058.045820:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.045899:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304525696 00000100:00100000:2.0:1787395058.045909:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304525696 00000100:00100000:2.0:1787395058.045995:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:2.0:1787395058.046005:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+57:10432:x1874219304525696:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395058.046024:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395058.046044:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8515 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22a8 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046129:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046143:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046164:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395058.046201:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395058.046220:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046245:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8515 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a8 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046279:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a8 expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.046289:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:2.0:1787395058.046292:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787395058.046303:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49a00, rc 0) 00000100:00100000:2.0:1787395058.046394:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+58:10432:x1874219304525696:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 390us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395058.046402:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:0.0:1787395058.052510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.052553:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304525824 00000100:00100000:0.0:1787395058.052562:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304525824 00000100:00100000:0.0:1787395058.052615:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:0.0:1787395058.052625:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304525824:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395058.052646:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395058.052670:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22af expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395058.052698:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897bf2, blocks: 0x1 00010000:00010000:0.0:1787395058.052717:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1787395058.052722:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395058.052731:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.052748:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.052762:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010a00, rc 0) 00000100:00100000:0.0:1787395058.052821:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304525824:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 197us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395058.052828:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:0.0:1787395058.076705:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.076797:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526080 00000100:00100000:2.0:1787395058.076807:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526080 00000100:00100000:2.0:1787395058.076871:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1787395058.076891:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+58:10432:x1874219304526080:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787395058.077001:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+58:10432:x1874219304526080:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 110us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395058.077008:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:0.0:1787395058.086118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.089002:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526208 00000100:00100000:2.0:1787395058.089017:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526208 00000100:00100000:0.0:1787395058.089824:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:0.0:1787395058.089836:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:10432:x1874219304526208:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395058.089863:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395058.089882:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22b6 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.089913:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.089921:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787395058.089925:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395058.089930:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.089965:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.089978:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 7 pid: 6599 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.089991:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323419904:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395058.090090:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787395058.096216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395058.096466:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526336 00000100:00100000:3.0:1787395058.096476:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526336 00010000:00010000:3.0:1787395058.096517:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 8 pid: 6599 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395058.096587:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:3.0:1787395058.096598:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304526336:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395058.096613:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395058.096636:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 8 pid: 6599 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.096651:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 8 pid: 6599 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.096682:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395058.096686:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395058.096695:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.096705:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.096744:0:11522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395058.096757:0:11522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34101aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11522:1874219323420032:192.168.203.16@tcp:105: 00000100:00100000:3.0:1787395058.096838:0:11522:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80e40 going to sleep for 11 seconds 00010000:00010000:0.0:1787395058.096907:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003683a88c/0xedbabbe2e89a8523 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22af expref: 8 pid: 6599 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.096924:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323419904:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395058.096958:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.096969:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395058.097001:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:10432:x1874219304526208:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 7167us (10890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395058.097008:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:1.0:1787395058.109570:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.109649:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526464 00000100:00100000:3.0:1787395058.109656:0:11522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34101aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11522:1874219323420032:192.168.203.16@tcp:105: 00000100:00100000:0.0:1787395058.109658:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526464 00010000:00010000:3.0:1787395058.109694:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1787395058.109710:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0b34116f100 x1874219304526464/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:519/0 lens 504/0 e 0 to 0 dl 1787395069 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395058.109722:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34116f100 with x1874219304526464 ext(0->8) 00002000:00010000:0.0:1787395058.109728:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34116f100 00000100:00100000:3.0:1787395058.109750:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304526336:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 13152us (13542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395058.109762:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:0.0:1787395058.109765:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1787395058.109777:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304526464:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787395058.110393:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304526464:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 Request processed in 617us (832us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787395058.110401:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00002000:00100000:0.0:1787395058.110407:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa0b34116f100 x1874219304526464/t4294967302(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:519/0 lens 504/448 e 0 to 0 dl 1787395069 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395058.110416:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34116f100 with x1874219304526464 ext(0->8) 00002000:00010000:0.0:1787395058.110420:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34116f100 00000100:00100000:3.0:1787395058.113435:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.113493:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526592 00000100:00100000:2.0:1787395058.113504:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526592 00000100:00100000:2.0:1787395058.113554:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:2.0:1787395058.113563:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+58:10432:x1874219304526592:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787395058.130995:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787395058.203143:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000100:00100000:0.0:1787395058.203295:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34101aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+56:10432:x1874219304526592:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 89727us (89865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395058.203348:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 00000001:00080000:2.0:1787395058.203349:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:2.0:1787395058.203369:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1787395058.203394:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b3413640c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1787395058.203399:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b3413646c0 00000020:00080000:2.0:1787395058.203402:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b318c8bc00 00000001:00080000:2.0:1787395058.203462:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1787395058.203467:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:2.0:1787395058.203471:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:3.0:1787395058.203538:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323420160:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1787395058.203595:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787395058.203601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395058.203623:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323420160 00000100:00100000:0.0:1787395058.203631:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323420160 00000100:00100000:0.0:1787395058.203683:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787395058.203692:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323420160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787395058.203721:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787395058.203754:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a897bef, atime: 0x6a897bef, ctime: 0x6a897bef, blocks: 0x1 00010000:00010000:0.0:1787395058.203764:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.203781:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1787395058.203786:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395058.203792:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.203808:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.203818:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.203827:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.203863:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787395058.205058:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395058.205079:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323420288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787395058.205131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395058.205425:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323420288 00000100:00100000:2.0:1787395058.205432:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323420288 00000100:00100000:2.0:1787395058.205485:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787395058.205493:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323420288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787395058.205638:0:8490:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787395058.205642:0:8490:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787395058 00002000:00010000:2.0:1787395058.205644:0:8490:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787395058.205646:0:8490:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787395058 -> 1787395058 00002000:00010000:2.0:1787395058.205654:0:8490:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787395058.205695:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323420288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (563us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787395058.205703:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787395058.205739:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b33ff3bb80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787395058.205744:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323420288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787395058.207944:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323420160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4244us (4336us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787395058.207958:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787395058.207996:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787395058.208001:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787395058.208015:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395058.208022:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.208034:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395058.208039:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.208049:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.208082:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.208089:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003683a88c/0xedbabbe2e89a8531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.208120:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395058.208122:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395058.208124:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787395058.208416:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b341019f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787395058.208425:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341019f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323420160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787395058.209027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.213345:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526720 00000100:00100000:0.0:1787395058.213359:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526720 00000100:00100000:0.0:1787395058.213419:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:0.0:1787395058.213428:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304526720:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1787395058.286957:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787395058.287218:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787395058.287366:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304526720:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 73933us (78337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395058.287378:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:1.0:1787395058.293378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.293698:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304526976 00000100:00100000:2.0:1787395058.293709:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304526976 00000100:00100000:2.0:1787395058.293955:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395058.293966:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+13:10432:x1874219304526976:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787395058.294018:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395058.294047:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a851c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a8 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.294066:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:2.0:1787395058.294071:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395058.294101:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.294114:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.294124:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395058.294454:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069506eed reply state 0000000078e6f129 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.294465:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395058.294574:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+14:10432:x1874219304526976:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 609us (1204us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787395058.294595:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00010000:00010000:2.0:1787395058.296259:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296274:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296282:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296288:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395058.296293:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296301:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296337:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:2.0:1787395058.296340:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395058.296344:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.296350:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.297021:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.297474:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304527104 00000100:00100000:0.0:1787395058.297483:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304527104 00000100:00100000:0.0:1787395058.297551:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:0.0:1787395058.297561:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304527104:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787395058.297801:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787395058.297805:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787395058 -> 1787395056 00002000:00010000:0.0:1787395058.297807:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787395055 00002000:00010000:0.0:1787395058.297810:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787395058 -> 1787395056 00002000:00010000:0.0:1787395058.297812:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787395058.297875:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304527104:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 315us (857us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787395058.297883:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:1.0:1787395058.307221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.307371:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304527360 00000100:00100000:0.0:1787395058.307381:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304527360 00000100:00100000:0.0:1787395058.307439:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:0.0:1787395058.307449:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+13:10432:x1874219304527360:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787395058.307526:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.307544:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 13 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.307554:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.307605:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 13 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.307619:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 13 pid: 11555 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.307634:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323420416:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395058.307730:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787395058.311032:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323420416:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395058.311063:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.311988:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395058.312519:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304527488 00000100:00100000:3.0:1787395058.312530:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304527488 00010000:00010000:3.0:1787395058.312624:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 14 pid: 11555 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395058.312666:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:3.0:1787395058.312675:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:2364:x1874219304527488:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395058.312690:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395058.312697:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 14 pid: 11555 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312711:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 14 pid: 11555 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312733:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a84f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc229a expref: 14 pid: 11555 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312767:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:3.0:1787395058.312772:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312781:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312788:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395058.312812:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395058.312825:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.312836:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314421:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314437:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314445:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314451:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395058.314456:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314464:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314479:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:1.0:1787395058.314483:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787395058.314938:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.314949:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a853f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.315076:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+13:10432:x1874219304527360:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 Request processed in 7625us (7860us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787395058.315100:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:2.0:1787395058.315134:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:2364:x1874219304527488:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2457us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395058.315156:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:3.0:1787395058.319416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.319525:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304527616 00000100:00100000:2.0:1787395058.319536:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304527616 00000100:00100000:2.0:1787395058.319586:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:2.0:1787395058.319596:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304527616:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787395058.319644:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.319676:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.319685:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395058.319690:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395058.319695:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.319740:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.319753:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 7 pid: 6601 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.319767:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323420544:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395058.319864:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3396019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395058.325475:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323420544:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395058.325508:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395058.327623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395058.327813:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304527744 00000100:00100000:1.0:1787395058.327899:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304527744 00010000:00010000:1.0:1787395058.327938:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.328019:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:1.0:1787395058.328030:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304527744:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395058.328044:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395058.328074:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.328088:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.328229:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a852a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22b6 expref: 8 pid: 6601 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.328247:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395058.328251:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395058.328268:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.328278:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.328401:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395058.328450:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304527744:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 422us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395058.328459:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00010000:00010000:2.0:1787395058.328622:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328633:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328659:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328668:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328676:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328683:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395058.328688:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328696:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328721:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.328729:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a8546 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.328788:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304527616:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 9192us (9380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395058.328797:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:2.0:1787395058.331931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.332467:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528000 00000100:00100000:0.0:1787395058.332478:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528000 00000100:00100000:0.0:1787395058.332637:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:0.0:1787395058.332646:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+12:10432:x1874219304528000:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787395058.332718:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.332744:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.332771:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.332986:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.332997:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.333005:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.333037:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.333060:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 13 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.333073:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323420672:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395058.333211:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787395058.337595:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323420672:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395058.337626:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.340578:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395058.341086:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528128 00000100:00100000:1.0:1787395058.341097:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528128 00010000:00010000:1.0:1787395058.341156:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 14 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.341201:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787395058.341210:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+14:2363:x1874219304528128:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395058.341226:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395058.341233:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 14 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341246:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 14 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341269:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22a1 expref: 14 pid: 5803 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341286:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:1.0:1787395058.341291:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341300:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341348:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.341379:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395058.341411:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.341419:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.341435:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+13:2363:x1874219304528128:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 227us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395058.341442:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000001:00080000:2.0:1787395058.341621:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1787395058.341768:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1787395058.341812:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1787395058.341888:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6624:1874219323420800:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787395058.341949:0:6624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395058.342097:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b339601480 going to sleep for 11 seconds 00000100:00100000:0.0:1787395058.342944:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323420800 00000100:00100000:0.0:1787395058.342953:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323420800 00000100:00100000:0.0:1787395058.343018:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787395058.343027:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6624:x1874219323420800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787395058.343131:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6624:x1874219323420800:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395058.343137:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787395058.344631:0:6624:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787395058.344641:0:6624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b33ff3bb80, transno 4294967303 00000100:00100000:1.0:1787395058.344664:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff39500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6624:1874219323420800:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787395058.345395:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787395058.345474:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6624:1874219323420928:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787395058.345538:0:6624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395058.345638:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395058.349936:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323420928 00000100:00100000:3.0:1787395058.349949:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323420928 00000100:00100000:3.0:1787395058.350015:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395058.350024:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6624:x1874219323420928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787395058.351058:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6624:x1874219323420928:12345-0@lo:1000:mdt00_003.0 Request processed in 1021us (5505us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787395058.351068:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787395058.353986:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6624:1874219323420928:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787395058.354037:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354058:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354066:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354072:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395058.354077:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354107:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354123:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:1.0:1787395058.354126:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395058.354131:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354137:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8554 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354188:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354195:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354200:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354205:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395058.354208:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354214:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354223:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:1.0:1787395058.354225:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395058.354228:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354244:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8482 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354269:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354284:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354294:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354350:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.354366:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 16 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395058.354380:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323421056:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395058.354514:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787395058.359640:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323421056:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395058.359667:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395058.367301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395058.368386:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528256 00000100:00100000:0.0:1787395058.368397:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528256 00010000:00010000:0.0:1787395058.368441:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 17 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.368517:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:0.0:1787395058.368527:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+17:2363:x1874219304528256:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395058.368543:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395058.368551:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 17 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368564:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 17 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368588:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a849e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2285 expref: 17 pid: 5804 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368604:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:0.0:1787395058.368609:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368619:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368626:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395058.368659:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395058.368701:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368710:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.368715:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+16:2363:x1874219304528256:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 190us (1424us total) trans 0 rc 0/0 00010000:00010000:2.0:1787395058.368723:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368730:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368736:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368741:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395058.368746:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395058.368748:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 46 00010000:00010000:2.0:1787395058.368753:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368762:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:2.0:1787395058.368765:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395058.368768:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368775:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a855b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368786:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368803:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368808:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368813:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395058.368816:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368833:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368842:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b3112e7c00) 00010000:00010000:2.0:1787395058.368845:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787395058.368848:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.368853:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a854d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.369075:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+15:10432:x1874219304528000:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 36430us (37151us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787395058.369084:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000020:00080000:2.0:1787395058.369088:0:6624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787395058.371677:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787395058.371687:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787395058.371735:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787395058.371742:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787395058.373704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395058.373994:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528512 00000100:00100000:2.0:1787395058.374004:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528512 00000100:00100000:2.0:1787395058.374059:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:2.0:1787395058.374069:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+15:10432:x1874219304528512:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787395058.375429:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787395058.375541:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787395058.375593:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375610:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375621:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375630:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375637:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375644:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395058.375665:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395058.375696:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395058.375705:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.375724:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395058.375729:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.375737:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395058.375751:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa0b3112e7f00) 00010000:00010000:1.0:1787395058.375754:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787395058.375759:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.375761:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+17:10432:x1874219304528512:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 1689us (2063us total) trans 4294967362 rc 0/0 00010000:00010000:1.0:1787395058.375771:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395058.375778:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000020:00080000:2.0:1787395058.375784:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787395058.375792:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395058.375795:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395058.375796:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395059.155568:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395059.283677:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395059.283719:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323421184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395059.283826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395059.284070:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421184 00000100:00100000:2.0:1787395059.284082:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421184 00000100:00100000:2.0:1787395059.284173:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787395059.284184:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323421184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395059.284239:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395059.284354:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323421184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395059.284363:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787395059.284420:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323421184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395059.800238:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323421568:0@lo:400:kworker.0 00000100:00100000:1.0:1787395059.800486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395059.800577:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421568 00000100:00100000:1.0:1787395059.800586:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421568 00000100:00100000:1.0:1787395059.800652:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787395059.800662:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323421568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395059.800722:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323421568:12345-0@lo:400:kworker.0 Request processed in 61us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395059.800730:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787395059.800957:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323421312:0@lo:400:kworker.0 00000100:00100000:0.0:1787395059.801003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395059.801034:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787395059.801041:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323421440:0@lo:400:kworker.0 00000100:00100000:0.0:1787395059.801067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787395059.801102:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395059.801116:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421440 00000100:00100000:0.0:1787395059.801120:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421440 00000100:00100000:0.0:1787395059.801160:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787395059.801167:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323421440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395059.801202:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323421440:12345-0@lo:400:kworker.0 Request processed in 35us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395059.801210:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787395059.801244:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323421440:0@lo:400:kworker.0 00000100:00100000:1.0:1787395059.801357:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323421568:0@lo:400:kworker.0 00000100:00100000:3.0:1787395059.802126:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787395059.802152:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323421696:0@lo:400:kworker.0 00000100:00100000:3.0:1787395059.802210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395059.802254:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421696 00000100:00100000:3.0:1787395059.802259:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421696 00000100:00100000:3.0:1787395059.802329:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787395059.802338:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323421696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395059.802382:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323421696:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395059.802390:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787395059.802430:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323421696:0@lo:400:kworker.0 00000100:00100000:3.0:1787395059.802464:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787395059.802472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b202ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323421824:0@lo:400:kworker.0 00000100:00100000:3.0:1787395059.802500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787395059.802910:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395059.802933:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421824 00000100:00100000:0.0:1787395059.802938:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421824 00000100:00100000:0.0:1787395059.802982:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787395059.802990:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323421824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395059.803039:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323421824:12345-0@lo:400:kworker.0 Request processed in 49us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395059.803058:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787395059.803104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b202ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323421824:0@lo:400:kworker.0 00000100:00100000:2.0:1787395059.803347:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323421312 00000100:00100000:2.0:1787395059.803354:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323421312 00000100:00100000:2.0:1787395059.803391:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787395059.803399:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323421312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395059.803446:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323421312:12345-0@lo:400:kworker.0 Request processed in 48us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395059.803454:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787395059.803574:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323421312:0@lo:400:kworker.0 00000040:00080000:1.0:1787395059.868844:0:11908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395059.868858:0:11908:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395059.868925:0:11908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787395059.868932:0:11908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787395060.000875:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.001189:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528768 00000100:00100000:1.0:1787395060.001202:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528768 00000100:00080000:0.0:1787395060.001532:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395060.001602:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:1.0:1787395060.001617:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+17:10450:x1874219304528768:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395060.001649:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.001675:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a8569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22bd expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.002019:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a8570 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.002037:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a8570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.002050:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a8570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395060.002065:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787395060.002303:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a8569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22bd expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.002350:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a8570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22bd expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.002372:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395060.002375:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787395060.002380:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030600, rc 0) 00000100:00100000:1.0:1787395060.002466:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:10450:x1874219304528768:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 853us (1605us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787395060.002475:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:3.0:1787395060.006356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.006525:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304528896 00000100:00100000:0.0:1787395060.006548:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304528896 00000100:00100000:0.0:1787395060.006622:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1787395060.006635:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10450:x1874219304528896:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395060.006739:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.006759:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.006775:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.006793:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.006801:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.006808:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007198:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007221:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007229:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395060.007282:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007297:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007356:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007364:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007371:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.007375:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007384:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007400:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395060.007403:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.007409:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007415:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a857e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007439:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007445:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007451:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007455:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.007459:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007465:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007473:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946e00) 00010000:00010000:0.0:1787395060.007475:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.007478:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007485:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007503:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007509:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007515:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007526:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.007529:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007535:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007543:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946300) 00010000:00010000:0.0:1787395060.007546:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.007549:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.007554:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a858c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.007662:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10450:x1874219304528896:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1026us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.007672:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1787395060.069866:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.069952:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304529152 00000100:00100000:3.0:1787395060.069965:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304529152 00000100:00100000:3.0:1787395060.070046:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:3.0:1787395060.070059:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+19:10453:x1874219304529152:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395060.070091:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395060.070121:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8593 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22c4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072774:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072806:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072836:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072854:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072861:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.072868:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.073286:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.073296:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.074429:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395060.074459:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787395060.077356:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077379:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077388:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077395:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.077414:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077423:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077444:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395060.077447:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.077452:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077460:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a859a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077478:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077485:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077490:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077495:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.077498:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077504:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077512:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b308bf3600) 00010000:00010000:3.0:1787395060.077515:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.077540:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077547:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077622:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8593 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077638:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.077645:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.077647:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395060.077650:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c400, rc 0) 00000100:00100000:3.0:1787395060.077745:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+21:10453:x1874219304529152:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 7687us (7893us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787395060.077756:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:1.0:1787395060.083841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.083964:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304529280 00000100:00100000:3.0:1787395060.083984:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304529280 00000100:00100000:3.0:1787395060.084057:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:3.0:1787395060.084069:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+21:10453:x1874219304529280:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:3.0:1787395060.084174:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084195:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084217:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084265:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084273:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084280:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084287:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.084292:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084301:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084655:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.084660:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787395060.084666:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.084673:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.084805:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+21:10453:x1874219304529280:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 736us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395060.084814:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:2.0:1787395060.102204:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.102854:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304529536 00000100:00100000:3.0:1787395060.102866:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304529536 00000100:00100000:3.0:1787395060.103249:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:3.0:1787395060.103274:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:10453:x1874219304529536:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395060.103683:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:10453:x1874219304529536:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 409us (1484us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787395060.103690:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:0.0:1787395060.155513:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.155628:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304529792 00000100:00100000:3.0:1787395060.155643:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304529792 00000100:00100000:3.0:1787395060.155723:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:3.0:1787395060.155734:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+22:9974:x1874219304529792:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395060.155768:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395060.155795:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22cb expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.155951:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.155968:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.155978:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.156025:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.156040:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 23 pid: 5804 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.156057:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323421952:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395060.156214:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d803c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395060.161155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.161365:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323421952:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395060.161410:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.165549:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304529920 00000100:00100000:2.0:1787395060.165571:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304529920 00010000:00010000:2.0:1787395060.165644:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 24 pid: 5804 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.165701:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:2.0:1787395060.165713:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+24:2365:x1874219304529920:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395060.165733:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395060.165741:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 24 pid: 5804 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.165757:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 24 pid: 5804 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.165787:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a85a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22c4 expref: 24 pid: 5804 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.165830:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:2.0:1787395060.165836:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.165846:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.165856:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.166082:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395060.166176:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+23:2365:x1874219304529920:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 465us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395060.166186:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00010000:00010000:3.0:1787395060.170663:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.170686:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395060.171436:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787395060.172679:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 24 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.172717:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 23 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.172728:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:0.0:1787395060.172751:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787395060.172756:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:0.0:1787395060.172902:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+23:9974:x1874219304529792:12345-192.168.203.16@tcp:101:bash.0 Request processed in 17169us (17404us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787395060.172912:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 88 00010000:00010000:0.0:1787395060.180836:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395060.182933:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.183048:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530176 00000100:00100000:3.0:1787395060.183061:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530176 00000100:00100000:3.0:1787395060.183180:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:3.0:1787395060.183193:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+23:9974:x1874219304530176:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:3.0:1787395060.184001:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.184026:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.184041:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787395060.184115:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787395060.184156:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a73e38fc reply state 000000009917b5a0 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.184168:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787395060.184297:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787395060.184818:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:9974:x1874219304530176:12345-192.168.203.16@tcp:36:bash.0 Request processed in 1622us (1894us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787395060.184830:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 89 00000020:00080000:3.0:1787395060.184838:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787395060.187928:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.187953:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.187963:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.187970:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.187977:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.187986:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.188044:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.188048:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.188055:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.188062:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.190717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.190826:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530304 00000100:00100000:3.0:1787395060.190840:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530304 00000100:00100000:3.0:1787395060.190915:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:3.0:1787395060.190927:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:9974:x1874219304530304:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395060.190986:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395060.191015:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.191112:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d2 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.191130:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d2 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.191164:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.191168:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395060.191171:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:3.0:1787395060.191246:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+27:9974:x1874219304530304:12345-192.168.203.16@tcp:101:bash.0 Request processed in 321us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395060.191254:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:2.0:1787395060.206802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.206930:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530432 00000100:00100000:0.0:1787395060.206942:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530432 00000100:00100000:0.0:1787395060.207056:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:0.0:1787395060.207067:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:9974:x1874219304530432:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395060.207090:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395060.207120:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22d9 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395060.207163:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a897bf0, atime: 0x6a897bef, ctime: 0x6a897bf0, blocks: 0xb 00010000:00010000:0.0:1787395060.207202:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1787395060.207208:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395060.207226:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.207247:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.207264:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395060.207374:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:9974:x1874219304530432:12345-192.168.203.16@tcp:101:bash.0 Request processed in 308us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.207382:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00080000:2.0:1787395060.207692:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395060.212925:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.213264:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530560 00000100:00100000:3.0:1787395060.213276:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530560 00002000:00010000:3.0:1787395060.213465:0:6605:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787395060.213472:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34116c380 with x1874219304530560 ext(0->18446744073709551615) 00002000:00010000:3.0:1787395060.213490:0:6605:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34116c380. 00000100:00100000:2.0:1787395060.213670:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787395060.213685:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304530560:12345-192.168.203.16@tcp:10:bash.0 00002000:00010000:2.0:1787395060.214070:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787395060.214096:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787395056 -> 1787395060 00002000:00010000:2.0:1787395060.214099:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787395055 -> 1787395055 00002000:00010000:2.0:1787395060.214102:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787395056 -> 1787395060 00002000:00010000:2.0:1787395060.214103:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787395060.214202:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304530560:12345-192.168.203.16@tcp:10:bash.0 Request processed in 520us (1290us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787395060.214212:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00002000:00010000:2.0:1787395060.214235:0:6605:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787395060.214239:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34116c380 with x1874219304530560 ext(0->18446744073709551615) 00002000:00010000:2.0:1787395060.214245:0:6605:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34116c380. 00000100:00100000:1.0:1787395060.308795:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323422080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395060.308892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395060.310191:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323422080 00000100:00100000:2.0:1787395060.310209:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323422080 00000100:00100000:2.0:1787395060.310349:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787395060.310362:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323422080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395060.310424:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395060.310516:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323422080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395060.310524:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787395060.310598:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323422080:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787395060.312296:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787395060.321776:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.322475:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530688 00000100:00100000:0.0:1787395060.322490:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530688 00000100:00100000:0.0:1787395060.322561:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:0.0:1787395060.322574:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+27:10468:x1874219304530688:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395060.322710:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.322732:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.322746:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.322763:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.322771:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.322778:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323083:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323092:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323099:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395060.323161:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323184:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323192:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323199:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323205:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.323211:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323219:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323234:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395060.323238:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.323244:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323251:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a85e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323265:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323271:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323277:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323288:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.323292:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323298:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323335:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946500) 00010000:00010000:0.0:1787395060.323338:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.323341:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323348:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a85ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323364:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323370:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323376:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323381:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.323384:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323390:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323409:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:0.0:1787395060.323411:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.323414:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.323420:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a85f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.323524:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+27:10468:x1874219304530688:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 950us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.323533:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00000001:00080000:2.0:1787395060.358033:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787395060.358060:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1787395060.385457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.385611:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304530944 00000100:00100000:3.0:1787395060.385624:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304530944 00000100:00100000:3.0:1787395060.385701:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:3.0:1787395060.385713:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:10471:x1874219304530944:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395060.385740:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395060.385766:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22e0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385885:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385902:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385915:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385934:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385942:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.385949:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386454:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386468:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386475:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395060.386486:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787395060.386613:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386621:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386635:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386642:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.386647:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386656:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386670:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395060.386673:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.386678:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386685:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8603 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386699:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386705:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386710:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386714:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.386717:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386732:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386740:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b308bf3600) 00010000:00010000:3.0:1787395060.386742:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.386745:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386751:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a860a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386804:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a85fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e0 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386818:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e0 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.386826:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.386829:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395060.386832:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395060.386911:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+29:10471:x1874219304530944:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1200us (1470us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787395060.386922:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:1.0:1787395060.394827:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.395050:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304531072 00000100:00100000:3.0:1787395060.395064:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304531072 00000100:00100000:3.0:1787395060.395199:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:3.0:1787395060.395213:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:10471:x1874219304531072:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:3.0:1787395060.395361:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.395382:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 29 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.395391:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.395435:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 29 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.395451:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 29 pid: 6624 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.395470:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323422208:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395060.395592:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395060.398983:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323422208:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395060.399027:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.403598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.404154:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304531328 00000100:00100000:2.0:1787395060.404169:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304531328 00000100:00100000:2.0:1787395060.404390:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:2.0:1787395060.404403:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+30:5576:x1874219304531328:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787395060.404836:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+31:5576:x1874219304531328:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 435us (1252us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787395060.404846:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:1.0:1787395060.407868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.408102:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304531456 00000100:00100000:0.0:1787395060.408117:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304531456 00010000:00010000:0.0:1787395060.408177:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 31 pid: 6624 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.408284:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:0.0:1787395060.408297:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+31:2364:x1874219304531456:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395060.408343:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395060.408351:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 31 pid: 6624 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408366:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 31 pid: 6624 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408393:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a85c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22cb expref: 31 pid: 6624 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408436:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:0.0:1787395060.408441:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408452:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408460:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.408513:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395060.408598:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+30:2364:x1874219304531456:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 302us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.408606:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00010000:00010000:1.0:1787395060.408725:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408734:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408774:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408793:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408800:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408807:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395060.408812:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408824:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408835:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:1.0:1787395060.408838:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395060.408841:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.408848:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a861f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.408895:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:10471:x1874219304531072:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 13685us (14080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395060.408905:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:1.0:1787395060.411601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.411732:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304531712 00000100:00100000:2.0:1787395060.411746:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304531712 00000100:00100000:2.0:1787395060.411813:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:2.0:1787395060.411824:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+29:10471:x1874219304531712:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395060.413448:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+30:10471:x1874219304531712:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 1616us (1851us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787395060.413478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000040:00080000:3.0:1787395060.434756:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787395060.434769:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787395060.434804:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787395060.434812:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787395060.513240:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.513410:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304531968 00000100:00100000:3.0:1787395060.513424:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304531968 00000100:00100000:3.0:1787395060.513514:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:3.0:1787395060.513527:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+30:10482:x1874219304531968:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:3.0:1787395060.513591:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395060.513620:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8626 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22e7 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513719:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513736:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513750:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513768:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513774:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.513781:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514284:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a863b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514298:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a863b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514359:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a863b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395060.514372:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787395060.514505:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514514:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514520:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514526:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.514531:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514539:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514554:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395060.514557:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.514563:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514569:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a862d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514584:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514590:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514596:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514601:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395060.514610:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514616:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514623:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b308bf3600) 00010000:00010000:3.0:1787395060.514626:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395060.514629:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514635:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514695:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8626 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e7 expref: 33 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514710:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a863b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e7 expref: 32 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.514718:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:3.0:1787395060.514720:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395060.514723:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55dc00, rc 0) 00000100:00100000:3.0:1787395060.514804:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+32:10482:x1874219304531968:12345-192.168.203.16@tcp:101:cat.0 Request processed in 1280us (1580us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787395060.514813:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:1.0:1787395060.522949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.523095:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304532224 00000100:00100000:3.0:1787395060.523108:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304532224 00000100:00100000:3.0:1787395060.523198:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:3.0:1787395060.523211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+32:10482:x1874219304532224:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:3.0:1787395060.523607:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:10482:x1874219304532224:12345-192.168.203.16@tcp:35:cat.0 Request processed in 398us (671us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787395060.523617:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787395060.555242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.555640:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304532480 00000100:00100000:0.0:1787395060.555653:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304532480 00000100:00100000:0.0:1787395060.555733:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 95 00000100:00100000:0.0:1787395060.555745:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+33:10483:x1874219304532480:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:0.0:1787395060.555824:0:11555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787395060.555860:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a863b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e7 expref: 33 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.555887:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22e0 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.555901:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a85d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d2 expref: 31 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.555937:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b308bf3100) 00010000:00010000:0.0:1787395060.555952:0:11555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395060.556179:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556196:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556208:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556225:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556232:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556239:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556737:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556747:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.556755:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787395060.558519:0:11555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787395060.558535:0:11555:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332507228351ns, next at 333507224670ns, rc = 0 00010000:00010000:0.0:1787395060.558695:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558714:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558727:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558736:0:11555:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558742:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558749:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558860:0:11555:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787395060.558891:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558898:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558904:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558911:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.558916:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558925:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558947:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395060.558950:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787395060.558956:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.558963:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8657 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559000:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559008:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559014:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559020:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395060.559023:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559029:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559037:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395060.559040:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395060.559043:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.559049:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395060.559070:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005063f860 reply state 000000005f9befa7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.559081:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395060.559242:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:10483:x1874219304532480:12345-192.168.203.16@tcp:36:rm.0 Request processed in 3493us (4008us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787395060.559252:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 95 00010000:00010000:1.0:1787395060.562760:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395060.562778:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.562818:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395060.562823:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.562939:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.562966:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395060.562969:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787395060.562975:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.562981:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a865e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.563015:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395060.563017:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395060.563019:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395060.564255:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564274:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564282:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564288:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395060.564293:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564301:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564355:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946500) 00010000:00010000:2.0:1787395060.564359:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395060.564364:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.564370:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.606502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.606630:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304532736 00000100:00100000:1.0:1787395060.606643:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304532736 00000100:00100000:1.0:1787395060.606718:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:1.0:1787395060.606730:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+31:10489:x1874219304532736:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395060.606763:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.606791:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a8665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22ee expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607407:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607448:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607462:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607482:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607490:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.607498:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395060.609619:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1787395060.609944:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.609965:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.609978:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610024:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610031:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610039:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610056:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395060.610061:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610070:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610085:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395060.610088:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395060.610093:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610100:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a866c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787395060.610119:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003909e535 reply state 000000009a5edc5d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.610129:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787395060.610185:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031000/0xedbabbe2e89a8665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610202:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.610211:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:1.0:1787395060.610213:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395060.610216:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030a00, rc 0) 00000100:00100000:1.0:1787395060.610594:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:10489:x1874219304532736:12345-192.168.203.16@tcp:101:bash.0 Request processed in 3865us (4105us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1787395060.610613:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 96 00010000:00010000:2.0:1787395060.614962:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615011:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615021:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615028:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300030e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395060.615034:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615043:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615065:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318517f00) 00010000:00010000:2.0:1787395060.615069:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395060.615075:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.615081:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a8673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.617554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.618411:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304532864 00000100:00100000:0.0:1787395060.618427:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304532864 00000100:00100000:0.0:1787395060.618518:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:0.0:1787395060.618530:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304532864:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395060.618554:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395060.618583:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22f5 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395060.618715:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787395060.618819:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787395060.618849:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1787395060.618855:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395060.618866:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.618889:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 6 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.618905:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010000, rc 0) 00000100:00100000:0.0:1787395060.619030:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304532864:12345-192.168.203.16@tcp:101:bash.0 Request processed in 501us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.619055:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:0.0:1787395060.627921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.628167:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304532992 00000100:00100000:1.0:1787395060.628181:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304532992 00000100:00100000:1.0:1787395060.628258:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:1.0:1787395060.628269:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:10489:x1874219304532992:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395060.628294:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.628379:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc22fc expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.628419:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.628430:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395060.628434:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395060.628441:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.628493:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 7 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.628508:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 7 pid: 6599 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.628524:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323422336:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395060.628672:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0480 going to sleep for 11 seconds 00000100:00100000:3.0:1787395060.633782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.633954:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304533120 00000100:00100000:0.0:1787395060.633964:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304533120 00010000:00010000:0.0:1787395060.634020:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 8 pid: 6599 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.634071:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:0.0:1787395060.634082:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304533120:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395060.634101:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395060.634141:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 8 pid: 6599 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.634157:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 8 pid: 6599 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.634185:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002671d7da/0xedbabbe2e89a8688 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22f5 expref: 8 pid: 6599 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.634206:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395060.634210:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395060.634219:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.634231:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.634301:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395060.634375:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5789:1874219323422464:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395060.634728:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323422336:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395060.634767:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.634780:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300031000, rc 0) 00000100:00100000:1.0:1787395060.634820:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:10489:x1874219304532992:12345-192.168.203.16@tcp:101:bash.0 Request processed in 6553us (6912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395060.634830:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:0.0:1787395060.635686:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395060.644612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395060.644650:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5789:1874219323422464:192.168.203.16@tcp:105: 00010000:00010000:0.0:1787395060.644683:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395060.644760:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304533120:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 10678us (10990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.644773:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:2.0:1787395060.645014:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304533376 00000100:00100000:2.0:1787395060.645024:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304533376 00000100:00100000:2.0:1787395060.645092:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:2.0:1787395060.645103:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:10489:x1874219304533376:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:2.0:1787395060.656868:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:10489:x1874219304533376:12345-192.168.203.16@tcp:35:bash.0 Request processed in 11747us (12254us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787395060.656888:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:3.0:1787395060.826541:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.826621:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304533504 00000100:00100000:1.0:1787395060.826635:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304533504 00000100:00100000:1.0:1787395060.826703:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:1.0:1787395060.826716:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+34:10505:x1874219304533504:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395060.826749:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.826775:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a8696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2303 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.826867:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.826885:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.826901:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395060.826996:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787395060.827001:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395060.827053:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.828046:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300031a00/0xedbabbe2e89a8696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2303 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.828695:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2303 expref: 35 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.828712:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395060.828716:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787395060.828721:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b300030800, rc 0) 00000100:00100000:1.0:1787395060.828880:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+35:10505:x1874219304533504:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2165us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395060.828891:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:1.0:1787395060.834665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.834728:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304533760 00000100:00100000:2.0:1787395060.834741:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304533760 00000100:00100000:2.0:1787395060.834819:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:2.0:1787395060.834831:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+35:10505:x1874219304533760:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395060.834861:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395060.834886:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a86a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc230a expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.835509:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a86ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.835531:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a86ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.835556:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a86ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395060.835572:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787395060.835744:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a86a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc230a expref: 38 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.835766:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a86ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc230a expref: 37 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.835777:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:2.0:1787395060.835780:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395060.835785:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49200, rc 0) 00000100:00100000:2.0:1787395060.835865:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+37:10505:x1874219304533760:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1035us (1215us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787395060.835889:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:2.0:1787395060.845577:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.845664:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.845911:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534144 00000100:00100000:1.0:1787395060.845923:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534144 00000100:00100000:0.0:1787395060.846154:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304533888 00000100:00100000:0.0:1787395060.846161:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304533888 00000100:00100000:1.0:1787395060.846276:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:1.0:1787395060.846288:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+38:10505:x1874219304534144:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395060.846336:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.846364:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a86b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2311 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.846512:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.846529:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.846944:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395060.846964:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787395060.847464:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030e00/0xedbabbe2e89a86b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2311 expref: 41 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.847491:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2311 expref: 40 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.847503:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:1.0:1787395060.847507:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787395060.847510:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129200, rc 0) 00000100:00100000:1.0:1787395060.852701:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+40:10505:x1874219304534144:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 6397us (7018us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1787395060.852717:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:0.0:1787395060.853574:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787395060.855740:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+39:2365:x1874219304533888:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395060.855780:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395060.855824:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a86ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc230a expref: 39 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395060.855856:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:0.0:1787395060.855863:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395060.856091:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+38:2365:x1874219304533888:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2503us (10545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395060.856102:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787395060.864573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395060.864660:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534272 00000100:00100000:3.0:1787395060.864673:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534272 00000100:00100000:3.0:1787395060.864741:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1787395060.864754:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304534272:12345-192.168.203.16@tcp:1:lfs.0 00010000:00010000:3.0:1787395060.864814:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.864839:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.864850:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395060.864855:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395060.864861:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.864906:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 6 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395060.864922:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 6 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.864960:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b337fff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323422592:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395060.865240:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395060.869021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.869351:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534400 00000100:00100000:2.0:1787395060.869364:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534400 00002000:00100000:2.0:1787395060.869430:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0b337ffd180 x1874219304534400/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:521/0 lens 504/0 e 0 to 0 dl 1787395071 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395060.869442:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b337ffd180 with x1874219304534400 ext(0->8) 00010000:00010000:2.0:1787395060.869453:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.869472:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 7 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395060.869481:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b337ffd180 00000100:00100000:2.0:1787395060.869522:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787395060.869532:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304534400:12345-192.168.203.16@tcp:4:lfs.0 00000100:00100000:2.0:1787395060.870606:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304534400:12345-192.168.203.16@tcp:4:lfs.0 Request processed in 1066us (1598us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787395060.870622:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00002000:00100000:2.0:1787395060.870632:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa0b337ffd180 x1874219304534400/t4294967302(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:521/0 lens 504/448 e 0 to 0 dl 1787395071 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395060.870642:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b337ffd180 with x1874219304534400 ext(0->8) 00010000:00010000:2.0:1787395060.870664:0:6606:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.870683:0:6606:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395060.870691:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b337ffd180 00000100:00100000:1.0:1787395060.870971:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b337fff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323422592:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395060.871017:0:6602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.875444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.875763:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534528 00000100:00100000:2.0:1787395060.875776:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534528 00010000:00010000:2.0:1787395060.875833:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.875882:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:2.0:1787395060.875894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304534528:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395060.875912:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787395060.875940:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787395060.875942:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787395060 00002000:00010000:2.0:1787395060.875945:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787395061 00002000:00010000:2.0:1787395060.875947:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787395060 00010000:00010000:2.0:1787395060.875953:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.876300:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.876361:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099e6353a/0xedbabbe2e89a868f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22fc expref: 9 pid: 6601 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.876406:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395060.876412:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395060.876418:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.876429:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.876472:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395060.876616:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304534528:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 723us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395060.876626:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 50 00010000:00010000:1.0:1787395060.876824:0:6602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876836:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876887:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876896:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876906:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876914:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395060.876919:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876930:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876947:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.876956:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007adbb970/0xedbabbe2e89a86ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.877035:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304534272:12345-192.168.203.16@tcp:1:lfs.0 Request processed in 12283us (12474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395060.877044:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1787395060.887879:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.888957:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534784 00000100:00100000:1.0:1787395060.889236:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534784 00000100:00100000:1.0:1787395060.889429:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:1.0:1787395060.889442:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+38:10505:x1874219304534784:12345-192.168.203.16@tcp:35:lfs.0 00000004:00010000:1.0:1787395060.889535:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2311 expref: 38 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395060.889876:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787395060.889927:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787395060.890700:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787395060.890781:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.890805:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.890815:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.890868:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.890886:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 42 pid: 5802 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.890904:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323422720:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395060.891211:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787395060.899641:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323422720:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395060.899685:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395060.901522:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.901814:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304534912 00000100:00100000:2.0:1787395060.901826:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304534912 00010000:00010000:2.0:1787395060.901878:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 43 pid: 5802 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395060.901929:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395060.901939:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+43:2366:x1874219304534912:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395060.901958:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395060.901976:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 43 pid: 5802 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.901992:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 43 pid: 5802 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.902040:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030a00/0xedbabbe2e89a867a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22ee expref: 43 pid: 5802 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.902062:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:2.0:1787395060.902068:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.902081:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.902100:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395060.902141:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395060.902208:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+42:2366:x1874219304534912:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 271us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395060.902217:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00010000:00010000:1.0:1787395060.902457:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.902466:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395060.902636:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787395060.902875:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787395060.903008:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323422848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787395060.903079:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395060.903123:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1787395060.903373:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323422848 00000100:00100000:2.0:1787395060.903381:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323422848 00000100:00100000:2.0:1787395060.903425:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787395060.903433:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323422848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787395060.903542:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323422848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 108us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395060.906801:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787395060.907461:0:5806:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787395060.907470:0:5806:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787395060.907496:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b341019f80, transno 4294967301 00000100:00100000:1.0:1787395060.907518:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323422848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787395060.909014:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787395060.909469:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323422976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787395060.909564:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395060.909614:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787395060.912065:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323422976 00000100:00100000:3.0:1787395060.912097:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323422976 00000100:00100000:3.0:1787395060.912192:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787395060.912204:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1874219323422976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787395060.912610:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1874219323422976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 405us (3043us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787395060.912620:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787395060.914641:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323422976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787395060.914780:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787395060.914863:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914878:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914887:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914911:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395060.914917:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914926:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914948:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:1.0:1787395060.914952:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787395060.914957:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.914974:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395060.915258:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787395060.915428:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787395060.915441:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332864134337ns, next at 333864132079ns, rc = 0 00000001:00080000:1.0:1787395060.915449:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787395060.915490:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517d00) 00010000:00010000:1.0:1787395060.915493:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787395060.915502:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2311 expref: 46 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395060.915668:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+45:10505:x1874219304534784:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 26228us (27803us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787395060.915680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000020:00080000:1.0:1787395060.915687:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787395060.921913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395060.922157:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304535040 00000100:00100000:1.0:1787395060.922172:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304535040 00000100:00100000:1.0:1787395060.922256:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:1.0:1787395060.922267:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+45:10505:x1874219304535040:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395060.922301:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395060.922353:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2318 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.922431:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2318 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.922448:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2318 expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395060.922470:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395060.922473:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395060.922477:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128600, rc 0) 00000100:00100000:1.0:1787395060.922552:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+46:10505:x1874219304535040:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 287us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395060.922560:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:3.0:1787395060.931722:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395060.931880:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304535296 00000100:00100000:2.0:1787395060.931894:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304535296 00000100:00100000:2.0:1787395060.932068:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395060.932088:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+46:10505:x1874219304535296:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395060.932759:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+47:10505:x1874219304535296:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 677us (1047us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787395060.932770:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395061.076135:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.076359:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304535424 00000100:00100000:0.0:1787395061.076393:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304535424 00000100:00100000:0.0:1787395061.076466:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:0.0:1787395061.076477:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+47:10515:x1874219304535424:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395061.076588:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076613:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076633:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076652:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076660:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076667:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076807:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076816:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076823:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395061.076874:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076902:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076909:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076916:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076922:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395061.076927:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.076936:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079556:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395061.079572:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395061.079587:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079601:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a86e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079634:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079642:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079650:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079685:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395061.079690:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079699:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079719:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946600) 00010000:00010000:0.0:1787395061.079722:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395061.079726:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079732:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a86ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079755:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079761:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079767:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079772:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395061.079775:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079781:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079803:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:0.0:1787395061.079805:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395061.079809:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.079814:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a86f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.079971:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+47:10515:x1874219304535424:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 3488us (3852us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.079985:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:2.0:1787395061.136817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.137113:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304535680 00000100:00100000:1.0:1787395061.137136:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304535680 00000100:00100000:1.0:1787395061.137220:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:1.0:1787395061.137232:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+47:10518:x1874219304535680:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395061.137259:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.137299:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc231f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137471:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137491:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137506:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137524:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137532:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137539:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137885:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137896:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.137903:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395061.137915:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787395061.138051:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138059:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138074:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138080:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.138085:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138094:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138109:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395061.138112:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.138117:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138124:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a86ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138152:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138159:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138165:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138171:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.138174:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138193:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138202:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318517d00) 00010000:00010000:1.0:1787395061.138204:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.138207:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138212:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138263:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a86f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 50 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138279:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 49 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.138286:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.138288:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395061.138291:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128800, rc 0) 00000100:00100000:1.0:1787395061.138889:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+49:10518:x1874219304535680:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1654us (2081us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787395061.138900:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:3.0:1787395061.149420:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.149707:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304535808 00000100:00100000:1.0:1787395061.149720:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304535808 00000100:00100000:1.0:1787395061.149788:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:1.0:1787395061.149801:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+49:10518:x1874219304535808:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:1.0:1787395061.149921:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.149943:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.149959:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150011:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150020:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150027:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150033:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.150038:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150046:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150060:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.150064:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395061.150069:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.150076:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a871b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.150200:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+49:10518:x1874219304535808:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 400us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.150208:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:2.0:1787395061.153934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.154085:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536064 00000100:00100000:3.0:1787395061.154100:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536064 00000100:00100000:3.0:1787395061.154226:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:3.0:1787395061.154239:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+49:10518:x1874219304536064:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395061.154634:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+50:10518:x1874219304536064:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 396us (713us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787395061.155109:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00010000:00010000:1.0:1787395061.202509:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395061.239458:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.240111:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536320 00000100:00100000:0.0:1787395061.240135:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536320 00000100:00100000:0.0:1787395061.240219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 104 00000100:00100000:0.0:1787395061.240231:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+50:10528:x1874219304536320:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395061.240267:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395061.240271:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787395061.240356:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030800/0xedbabbe2e89a869d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2303 expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240383:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395061.240389:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395061.240407:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2326 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240541:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240852:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 50 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240862:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240905:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 50 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.240921:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 50 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.240938:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323423104:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395061.241145:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787395061.249939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.250050:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536448 00000100:00100000:0.0:1787395061.250058:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323423104:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395061.250060:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536448 00010000:00010000:0.0:1787395061.250105:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250108:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 51 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.250194:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:1.0:1787395061.250206:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+51:2364:x1874219304536448:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395061.250223:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395061.250231:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 51 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250244:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 51 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250274:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a870d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc231f expref: 51 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250294:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.250300:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250341:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250369:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.250400:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395061.250443:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.250461:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.250469:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+50:2364:x1874219304536448:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 265us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.250476:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000004:00200000:3.0:1787395061.250485:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787395061.250783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a8722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 51 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.250801:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 50 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.250809:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395061.250811:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787395061.250814:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010400, rc 0) 00000100:00100000:3.0:1787395061.250845:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+50:10528:x1874219304536320:12345-192.168.203.16@tcp:101:bash.0 Request processed in 10617us (11404us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787395061.250853:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 104 00000100:00100000:2.0:1787395061.256928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.257010:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536704 00000100:00100000:1.0:1787395061.257024:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536704 00000100:00100000:1.0:1787395061.257108:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 105 00000100:00100000:1.0:1787395061.257120:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+50:10528:x1874219304536704:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:1.0:1787395061.258259:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.258290:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.258332:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395061.258400:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787395061.258432:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbddf83b reply state 0000000098b7c53a transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.258442:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395061.258600:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+53:10528:x1874219304536704:12345-192.168.203.16@tcp:36:bash.0 Request processed in 1478us (1679us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787395061.258610:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 105 00000020:00080000:1.0:1787395061.258617:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395061.263147:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263172:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263180:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263185:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395061.263191:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263199:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263223:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395061.263226:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395061.263231:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.263266:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8737 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.264291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.264488:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536832 00000100:00100000:1.0:1787395061.264501:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536832 00000100:00100000:1.0:1787395061.264564:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 106 00000100:00100000:1.0:1787395061.264576:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+52:10528:x1874219304536832:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395061.264606:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.264630:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a873e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc232d expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.264738:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.264754:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.264763:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.264808:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.264824:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 53 pid: 5803 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.264841:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423232:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395061.264954:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787395061.267864:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.267950:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304536960 00000100:00100000:3.0:1787395061.267961:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304536960 00010000:00010000:3.0:1787395061.268016:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 54 pid: 5803 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.268059:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:3.0:1787395061.268069:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+54:2364:x1874219304536960:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395061.268120:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395061.268137:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 54 pid: 5803 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.268162:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 54 pid: 5803 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.268191:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395061.268197:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.268209:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.268217:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.268238:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395061.268295:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+54:2364:x1874219304536960:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 226us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.268303:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00010000:00010000:2.0:1787395061.269014:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8729 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2326 expref: 53 pid: 5803 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.269036:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423232:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395061.269063:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.269073:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.269089:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395061.269181:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787395061.269187:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395061.269211:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.269249:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a873e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 53 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.269267:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 52 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.269275:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395061.269291:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395061.269295:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129c00, rc 0) 00000100:00100000:2.0:1787395061.269371:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+52:10528:x1874219304536832:12345-192.168.203.16@tcp:101:bash.0 Request processed in 4797us (5091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.269379:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 106 00000100:00100000:2.0:1787395061.276034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.276251:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537216 00000100:00100000:1.0:1787395061.276267:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537216 00000100:00100000:1.0:1787395061.276423:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:1.0:1787395061.276454:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+52:10528:x1874219304537216:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:1.0:1787395061.276794:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10528:x1874219304537216:12345-192.168.203.16@tcp:35:bash.0 Request processed in 335us (768us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787395061.276805:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:2.0:1787395061.363598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.363805:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537344 00000100:00100000:3.0:1787395061.363819:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537344 00000100:00100000:3.0:1787395061.363898:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 107 00000100:00100000:3.0:1787395061.363910:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+53:10534:x1874219304537344:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395061.363945:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395061.363985:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a874c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2334 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364078:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364138:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364152:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395061.364240:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787395061.364245:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395061.364274:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364337:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a874c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2334 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364360:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2334 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.364371:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395061.364374:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395061.364378:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395061.364467:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304537344:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 559us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.364476:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 107 00000100:00100000:0.0:1787395061.374644:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.374757:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537472 00000100:00100000:1.0:1787395061.374771:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537472 00000100:00100000:1.0:1787395061.374848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 108 00000100:00100000:1.0:1787395061.374861:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304537472:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395061.374890:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.374916:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a875a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc233b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375017:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375035:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375049:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375067:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375075:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375081:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375242:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375251:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375259:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395061.375338:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787395061.375343:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395061.375371:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375384:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375394:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375402:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375409:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375416:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.375420:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375430:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375452:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395061.375455:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.375461:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375467:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375484:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375490:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375495:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375500:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.375503:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375508:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375515:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318517d00) 00010000:00010000:1.0:1787395061.375517:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.375520:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375526:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375586:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a875a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375602:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.375608:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.375610:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395061.375613:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129a00, rc 0) 00000100:00100000:1.0:1787395061.375706:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+55:10534:x1874219304537472:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 847us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.375715:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 108 00000100:00100000:2.0:1787395061.384921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.385104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.385426:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537856 00000100:00100000:3.0:1787395061.385441:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537856 00000100:00100000:3.0:1787395061.385527:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 109 00000100:00100000:3.0:1787395061.385539:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+55:10534:x1874219304537856:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395061.385582:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395061.385614:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2342 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385742:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385759:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385768:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385776:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385815:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385828:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 56 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.385843:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b337fff100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423360:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395061.385975:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.385985:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.385994:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423488:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395061.386024:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787395061.388286:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537600 00000100:00100000:1.0:1787395061.388323:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537600 00010000:00010000:1.0:1787395061.388387:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 57 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.388818:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787395061.388833:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+57:2366:x1874219304537600:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395061.388853:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395061.388861:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 57 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.388877:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 57 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.388928:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:0.0:1787395061.388935:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.388945:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.388954:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395061.390844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395061.390948:0:11555:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.16@tcp) returned -22 from blocking AST (req@00000000353f145f x1874219323423360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 57 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.391033:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304537984 00000100:00100000:1.0:1787395061.391043:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304537984 00010000:00010000:1.0:1787395061.391105:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 58 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.391201:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129a00/0xedbabbe2e89a876f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc233b expref: 58 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.391224:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b337fff100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423360:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395061.391245:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff78a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323423488:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395061.391277:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395061.391283:0:11555:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.391293:0:11555:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.391303:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.391690:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+57:2366:x1874219304537600:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2858us (6781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.391703:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787395061.391738:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:0.0:1787395061.391750:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+56:2363:x1874219304537984:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395061.391766:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395061.391774:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391787:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391814:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8745 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc232d expref: 56 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391827:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:0.0:1787395061.391831:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391860:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391869:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.391902:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395061.391928:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+55:2363:x1874219304537984:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 182us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.391935:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00010000:00010000:2.0:1787395061.392100:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.392116:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395061.392149:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787395061.392382:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 56 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.392400:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 55 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.392409:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395061.392412:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395061.392414:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:2.0:1787395061.392449:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+55:10534:x1874219304537856:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 6912us (7345us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787395061.392456:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 109 00000100:00100000:2.0:1787395061.397210:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.397439:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304538240 00000100:00100000:1.0:1787395061.397452:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304538240 00000100:00100000:1.0:1787395061.397643:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:1.0:1787395061.397656:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+55:10534:x1874219304538240:12345-192.168.203.16@tcp:103:lfs.0 00010000:00010000:1.0:1787395061.397678:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395061.397733:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a86dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2318 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.397758:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.397765:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395061.397863:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304538240:12345-192.168.203.16@tcp:103:lfs.0 Request processed in 210us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.397872:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395061.400878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.400977:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304538368 00000100:00100000:1.0:1787395061.400990:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304538368 00000100:00100000:1.0:1787395061.401077:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:1.0:1787395061.401090:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304538368:12345-192.168.203.16@tcp:58:lfs.0 00010000:00010000:1.0:1787395061.401276:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.401299:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.401341:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787395061.401755:0:6624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787395061.401890:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304538368:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 799us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.401900:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 110 00000100:00100000:2.0:1787395061.406734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.406835:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304538496 00000100:00100000:3.0:1787395061.406849:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304538496 00000100:00100000:3.0:1787395061.406934:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 111 00000100:00100000:3.0:1787395061.406948:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+54:10534:x1874219304538496:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395061.406977:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395061.407006:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2349 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407092:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407105:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407139:0:5804:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407155:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407171:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395061.407175:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395061.407179:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.407189:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:3.0:1787395061.407289:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+55:10534:x1874219304538496:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 344us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.407298:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 111 00000040:00080000:3.0:1787395061.458685:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787395061.458699:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787395061.458793:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787395061.458801:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787395061.459000:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323423616:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787395061.459368:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395061.465055:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323423616:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787395061.467589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.467837:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304538624 00000100:00100000:0.0:1787395061.467852:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304538624 00000100:00100000:0.0:1787395061.467938:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00100000:0.0:1787395061.467951:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+55:10535:x1874219304538624:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787395061.468004:0:11555:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787395061.468439:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+55:10535:x1874219304538624:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 489us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.468450:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 112 00000100:00100000:2.0:1787395061.474241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.474398:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304538752 00000100:00100000:1.0:1787395061.474411:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304538752 00000100:00100000:1.0:1787395061.474490:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 113 00000100:00100000:1.0:1787395061.474502:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+55:10535:x1874219304538752:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.474621:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.474641:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.474657:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476531:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476554:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476568:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476602:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476611:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476617:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395061.476661:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787395061.476665:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395061.476680:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476692:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476712:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476719:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476725:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.476729:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476736:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476750:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:1.0:1787395061.476753:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.476758:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476764:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a8799 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476781:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476787:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476793:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476799:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.476807:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476814:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476822:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa0b318517d00) 00010000:00010000:1.0:1787395061.476824:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.476827:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476833:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476848:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476853:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476859:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476864:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.476866:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.476998:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.477010:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.477013:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.477021:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.477027:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.477238:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+55:10535:x1874219304538752:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 2734us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.477248:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 113 00000100:00100000:2.0:1787395061.483382:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.483489:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304539008 00000100:00100000:1.0:1787395061.483500:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304539008 00000100:00100000:1.0:1787395061.483572:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:1.0:1787395061.483586:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+55:10535:x1874219304539008:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.483610:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.483632:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2350 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483733:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483748:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483773:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395061.483785:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787395061.483883:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483891:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483912:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483918:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.483921:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483929:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483942:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.483946:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787395061.483951:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483958:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.483998:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87ae lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2350 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.484008:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:1.0:1787395061.484010:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395061.484014:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2350 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.484023:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128e00, rc 0) 00000100:00100000:1.0:1787395061.484086:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539008:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 505us (714us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787395061.484102:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:2.0:1787395061.490561:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.490934:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304539136 00000100:00100000:0.0:1787395061.490944:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304539136 00000100:00100000:0.0:1787395061.491015:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:0.0:1787395061.491025:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539136:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787395061.491060:0:11555:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787395061.491175:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539136:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 151us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.491183:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:3.0:1787395061.498354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.498476:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304539392 00000100:00100000:0.0:1787395061.498486:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304539392 00000100:00100000:0.0:1787395061.498549:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:0.0:1787395061.498558:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539392:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395061.498582:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395061.498587:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787395061.498616:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2334 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.498635:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:0.0:1787395061.498640:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395061.498654:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a87c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2357 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787395061.500355:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787395061.500587:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a87ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.500603:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a87ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.500613:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a87ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.500672:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a87c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2357 expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.500691:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a87ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2357 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.500715:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318946600) 00010000:00010000:0.0:1787395061.500718:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395061.500721:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010a00, rc 0) 00000100:00100000:0.0:1787395061.500798:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+57:10535:x1874219304539392:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 2240us (2497us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787395061.500807:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:2.0:1787395061.509569:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.509701:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304539648 00000100:00100000:1.0:1787395061.509710:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304539648 00000100:00100000:1.0:1787395061.509864:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787395061.509874:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+57:10535:x1874219304539648:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.509931:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395061.510020:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a87ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2357 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510040:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318946600) 00010000:00010000:1.0:1787395061.510053:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395061.510075:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510159:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510169:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510187:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510194:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510201:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510292:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510298:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510302:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510475:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.510480:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510488:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510497:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:1.0:1787395061.510504:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.510509:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510515:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a87d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510526:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510532:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510537:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510551:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.510554:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510560:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510568:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xecfb1df5 (ffffa0b318517d00) 00010000:00010000:1.0:1787395061.510570:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395061.510573:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.510578:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a87df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xecfb1df5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.510662:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539648:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 788us (1101us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787395061.510671:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:2.0:1787395061.513187:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.513390:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304539776 00000100:00100000:1.0:1787395061.513399:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304539776 00000100:00100000:1.0:1787395061.513456:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:1.0:1787395061.513466:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+56:10535:x1874219304539776:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.513485:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.513505:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc235e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513539:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513569:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513579:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513670:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513690:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 57 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.513699:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:1.0:1787395061.513701:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787395061.513704:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128c00, rc 0) 00000100:00100000:1.0:1787395061.513759:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+57:10535:x1874219304539776:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 293us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.513767:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:3.0:1787395061.518584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.519122:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540032 00000100:00100000:0.0:1787395061.519143:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540032 00000100:00100000:0.0:1787395061.519203:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:0.0:1787395061.519213:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+57:10535:x1874219304540032:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787395061.519301:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.519353:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.519364:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787395061.519619:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1787395061.519706:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c308d107 reply state 00000000157626d5 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.519717:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395061.519804:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+59:10535:x1874219304540032:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 591us (1229us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787395061.519811:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 119 00010000:00010000:2.0:1787395061.522580:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522624:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522632:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522638:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395061.522644:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522651:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522668:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:2.0:1787395061.522671:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787395061.522675:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.522682:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a87f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.523901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.523984:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540160 00000100:00100000:1.0:1787395061.523994:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540160 00000100:00100000:1.0:1787395061.524052:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:1.0:1787395061.524063:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+58:10535:x1874219304540160:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.524096:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.524115:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2365 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.524179:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 59 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.524207:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 59 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.524228:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:1.0:1787395061.524231:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395061.524234:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128600, rc 0) 00000100:00100000:1.0:1787395061.524300:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+59:10535:x1874219304540160:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 239us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.524333:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:0.0:1787395061.527776:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.527846:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540288 00000100:00100000:2.0:1787395061.527855:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540288 00000100:00100000:2.0:1787395061.527905:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1787395061.527914:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304540288:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787395061.528227:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304540288:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 313us (457us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787395061.528235:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:3.0:1787395061.530877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.531054:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540544 00000100:00100000:1.0:1787395061.531065:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540544 00000100:00100000:1.0:1787395061.531142:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:1.0:1787395061.531152:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+59:10535:x1874219304540544:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787395061.531427:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+60:10535:x1874219304540544:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 276us (560us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787395061.531434:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:3.0:1787395061.540170:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.540270:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540800 00000100:00100000:2.0:1787395061.540294:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540800 00000100:00100000:2.0:1787395061.540373:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1787395061.540382:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+60:10535:x1874219304540800:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787395061.540490:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+60:10535:x1874219304540800:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.540497:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:0.0:1787395061.552548:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.552654:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304540928 00000100:00100000:2.0:1787395061.552663:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304540928 00000100:00100000:2.0:1787395061.552714:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:2.0:1787395061.552724:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+60:10535:x1874219304540928:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395061.552745:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395061.552767:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc236c expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552840:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552853:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552865:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395061.552898:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395061.552913:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552935:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc236c expref: 62 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552979:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc236c expref: 61 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.552988:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:2.0:1787395061.552991:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787395061.552994:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787395061.553052:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+61:10535:x1874219304540928:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 330us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.553059:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:3.0:1787395061.557704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.557895:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541056 00000100:00100000:0.0:1787395061.557906:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541056 00000100:00100000:0.0:1787395061.557961:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:0.0:1787395061.557976:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304541056:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395061.557993:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395061.558012:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2373 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395061.558037:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897bf5, blocks: 0x1 00010000:00010000:0.0:1787395061.558055:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1787395061.558060:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395061.558069:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 10 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.558085:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 10 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.558110:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010c00, rc 0) 00000100:00100000:0.0:1787395061.558178:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+10:2364:x1874219304541056:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 203us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.558186:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1787395061.562947:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.563030:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541312 00000100:00100000:2.0:1787395061.563039:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541312 00000100:00100000:2.0:1787395061.563097:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:2.0:1787395061.563107:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+61:10535:x1874219304541312:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787395061.563222:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+61:10535:x1874219304541312:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.563230:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:2.0:1787395061.577528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.577752:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541440 00000100:00100000:0.0:1787395061.577763:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541440 00000100:00100000:0.0:1787395061.577824:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:0.0:1787395061.577835:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+10:10535:x1874219304541440:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395061.577869:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395061.577959:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc237a expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.577995:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 11 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.578195:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395061.578201:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395061.578208:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.578245:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 11 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.578260:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 11 pid: 6599 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.578276:0:8490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874219323423744:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395061.578537:0:8490:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1600 going to sleep for 11 seconds 00000100:00100000:3.0:1787395061.582533:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.582634:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541568 00000100:00100000:2.0:1787395061.582644:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541568 00010000:00010000:2.0:1787395061.582685:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 12 pid: 6599 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.582731:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:2.0:1787395061.582742:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:2364:x1874219304541568:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395061.582773:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395061.582795:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 12 pid: 6599 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.582809:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 12 pid: 6599 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.582835:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395061.582840:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395061.582849:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.582858:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.582894:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 12 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.582909:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1874219323423872:192.168.203.16@tcp:105: 00000100:00100000:2.0:1787395061.583122:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912d600 going to sleep for 11 seconds 00010000:00010000:0.0:1787395061.583733:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0888f56/0xedbabbe2e89a8810 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2373 expref: 12 pid: 6599 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.583751:0:8490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8490:1874219323423744:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395061.583776:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.583800:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011c00, rc 0) 00000100:00100000:0.0:1787395061.583845:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+11:10535:x1874219304541440:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 6012us (6327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.583854:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:2.0:1787395061.589975:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5787:1874219323423872:192.168.203.16@tcp:105: 00010000:00010000:2.0:1787395061.590001:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395061.590053:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+10:2364:x1874219304541568:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 7313us (7529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.590063:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787395061.591501:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.591731:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541696 00000100:00100000:2.0:1787395061.591740:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541696 00002000:00100000:2.0:1787395061.591792:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0b32fa53800 x1874219304541696/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:522/0 lens 504/0 e 0 to 0 dl 1787395072 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395061.591804:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b32fa53800 with x1874219304541696 ext(0->12) 00002000:00010000:2.0:1787395061.591810:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b32fa53800 00000100:00100000:2.0:1787395061.591841:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:2.0:1787395061.591849:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+10:2363:x1874219304541696:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787395061.592507:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:2363:x1874219304541696:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 Request processed in 657us (1013us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787395061.592515:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00002000:00100000:2.0:1787395061.592522:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa0b32fa53800 x1874219304541696/t4294967308(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:522/0 lens 504/448 e 0 to 0 dl 1787395072 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395061.592530:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b32fa53800 with x1874219304541696 ext(0->12) 00002000:00010000:2.0:1787395061.592534:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b32fa53800 00000100:00100000:0.0:1787395061.596001:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.596149:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541824 00000100:00100000:3.0:1787395061.596160:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541824 00000100:00100000:3.0:1787395061.596220:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:3.0:1787395061.596231:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+61:10535:x1874219304541824:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787395061.620466:0:11868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1787395061.620487:0:11868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787395061.620502:0:11868:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1787395061.620514:0:11868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787395061.620531:0:11868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787395061.620548:0:11868:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b2022d0000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787395061.620553:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b308c5bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b2022d0b40 00000020:00080000:0.0:1787395061.620556:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b308c5b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b33f40e800 00000020:00080000:0.0:1787395061.620574:0:11868:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b305c9f540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787395061.620577:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b329105800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b305c9f3c0 00000020:00080000:0.0:1787395061.620580:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b329105900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b3082c5400 00000020:00080000:0.0:1787395061.620749:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787395061.620918:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787395061.621325:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:10535:x1874219304541824:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 25070us (25308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.621337:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:0.0:1787395061.622777:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323424000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787395061.622836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395061.622876:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395061.622883:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323424128:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787395061.622901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395061.623088:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323424000 00000100:00100000:2.0:1787395061.623096:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323424000 00000100:00100000:2.0:1787395061.623158:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323424128 00000100:00100000:2.0:1787395061.623161:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323424128 00000100:00100000:2.0:1787395061.623181:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787395061.623189:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323424000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787395061.623216:0:6599:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787395061.623240:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.623260:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.623274:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787395061.623278:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395061.623283:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.623334:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 11 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.623348:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 11 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.623360:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323424256:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395061.623411:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3367a89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395061.623522:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787395061.623531:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874219323424128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787395061.623545:0:6601:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787395061.623571:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a897bf4, atime: 0x6a897bf5, ctime: 0x6a897bf4, blocks: 0x1 00010000:00010000:0.0:1787395061.623577:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.623586:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1787395061.623589:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395061.623595:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.623609:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.623618:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.623626:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.623648:0:6601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395061.624988:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395061.624998:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.625010:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010c00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395061.625016:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.625026:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.625056:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.625064:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0888f56/0xedbabbe2e89a8825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.625094:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395061.625096:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395061.625097:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395061.625191:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323424128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1659us (2285us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787395061.625201:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787395061.625394:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395061.625511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.626432:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304541952 00000100:00100000:2.0:1787395061.626442:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304541952 00000100:00100000:2.0:1787395061.626489:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:2.0:1787395061.626498:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+12:2363:x1874219304541952:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787395061.629421:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323424256:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395061.629454:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395061.629826:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b341009180/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787395061.629834:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323424128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787395061.631472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.632668:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542080 00000100:00100000:3.0:1787395061.632678:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542080 00010000:00010000:3.0:1787395061.632713:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 13 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.632742:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:3.0:1787395061.632751:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+13:2363:x1874219304542080:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395061.632763:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395061.632768:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 13 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632781:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 13 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632803:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065cc4d28/0xedbabbe2e89a85e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22d9 expref: 13 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632821:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395061.632826:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395061.632831:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632850:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632875:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395061.632924:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+12:2363:x1874219304542080:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 174us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.632931:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00010000:00010000:3.0:1787395061.632953:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632974:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632984:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.632992:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633007:0:6599:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787395061.633687:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323424000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10496us (10847us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787395061.633696:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787395061.633724:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395061.633730:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633746:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395061.633750:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633759:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633775:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633781:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a881e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.633798:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395061.633800:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395061.633801:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787395061.634120:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b34100b100/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787395061.634147:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323424000:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787395061.688313:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787395061.688969:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1787395061.688989:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787395061.691936:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304541952:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 65429us (66416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.691950:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:1.0:1787395061.697151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.697296:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542336 00000100:00100000:2.0:1787395061.697334:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542336 00000100:00100000:2.0:1787395061.697390:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:2.0:1787395061.697401:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+15:10535:x1874219304542336:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787395061.697451:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395061.697479:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc236c expref: 15 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.697498:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:2.0:1787395061.697502:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395061.697531:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.697573:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.697583:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395061.697802:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000024f4e8d2 reply state 000000008fa90fe5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.697810:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395061.697901:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+16:10535:x1874219304542336:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 502us (759us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787395061.697909:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:2.0:1787395061.700419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:0.0:1787395061.700517:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700532:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700540:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700546:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395061.700551:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700559:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700575:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:0.0:1787395061.700578:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395061.700583:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.700589:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a882c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.700939:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542464 00000100:00100000:1.0:1787395061.700950:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542464 00000100:00100000:1.0:1787395061.701034:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:1.0:1787395061.701044:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3390d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304542464:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787395061.701266:0:6601:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787395061.701270:0:6601:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787395061 00002000:00010000:1.0:1787395061.701272:0:6601:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787395061 00002000:00010000:1.0:1787395061.701274:0:6601:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787395061 -> 1787395061 00002000:00010000:1.0:1787395061.701276:0:6601:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787395061.701363:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3390d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304542464:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 319us (951us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787395061.701371:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:0.0:1787395061.703616:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.703683:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542720 00000100:00100000:1.0:1787395061.703692:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542720 00000100:00100000:1.0:1787395061.703742:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:1.0:1787395061.703751:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+15:10535:x1874219304542720:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.703814:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.703830:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.703838:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.703867:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.703898:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 15 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.703912:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323424384:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395061.704048:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395061.706822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.707349:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542848 00000100:00100000:3.0:1787395061.707358:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542848 00010000:00010000:3.0:1787395061.707396:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 16 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.707433:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:3.0:1787395061.707442:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:2363:x1874219304542848:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395061.707455:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395061.707474:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 16 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.707486:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 16 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.707509:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:3.0:1787395061.707514:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.707523:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.707530:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.707558:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395061.707614:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:2363:x1874219304542848:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 173us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.707621:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00010000:00010000:2.0:1787395061.708683:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a87ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc235e expref: 15 pid: 5802 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.708703:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323424384:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395061.708723:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708732:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708738:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708767:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708789:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708797:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708803:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395061.708808:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708814:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708825:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:2.0:1787395061.708828:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787395061.708832:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.708838:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a8833 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.708950:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+14:10535:x1874219304542720:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 Request processed in 5199us (5341us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787395061.708960:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:3.0:1787395061.710946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.711023:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304542976 00000100:00100000:0.0:1787395061.711032:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304542976 00000100:00100000:0.0:1787395061.711095:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:0.0:1787395061.711104:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304542976:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787395061.711154:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.711189:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.711199:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395061.711203:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787395061.711208:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.711242:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 7 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.711255:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 7 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.711269:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323424512:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395061.711688:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395061.714789:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323424512:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395061.714817:0:6599:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.715068:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.715169:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304543104 00000100:00100000:1.0:1787395061.715175:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304543104 00010000:00010000:1.0:1787395061.715210:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 8 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.715246:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:1.0:1787395061.715254:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304543104:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395061.715268:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395061.715289:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 8 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.715302:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 8 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.715344:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43100f7/0xedbabbe2e89a8817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc237a expref: 8 pid: 8490 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.715360:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395061.715364:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395061.715384:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.715394:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.715425:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395061.715469:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304543104:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 214us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.715476:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00010000:00010000:0.0:1787395061.715535:0:6599:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715545:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715576:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715585:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715594:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715602:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395061.715607:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715617:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715630:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.715638:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a883a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.715685:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304542976:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 4581us (4745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395061.715693:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:1.0:1787395061.717676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.717745:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304543360 00000100:00100000:3.0:1787395061.717755:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304543360 00000100:00100000:3.0:1787395061.717830:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 127 00000100:00100000:3.0:1787395061.717838:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+14:10535:x1874219304543360:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787395061.717905:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.717920:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.717941:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.718151:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.718161:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 15 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.718169:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.718197:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 15 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.718210:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 15 pid: 6624 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.718224:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323424640:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395061.718299:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395061.720518:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323424640:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395061.720555:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.721185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.721379:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304543488 00000100:00100000:3.0:1787395061.721385:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304543488 00010000:00010000:3.0:1787395061.721418:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 16 pid: 6624 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395061.721465:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:3.0:1787395061.721473:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:2364:x1874219304543488:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395061.721487:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395061.721493:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 16 pid: 6624 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721506:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 16 pid: 6624 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721526:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128600/0xedbabbe2e89a87fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2365 expref: 16 pid: 6624 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721542:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:3.0:1787395061.721558:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721567:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721574:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.721598:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395061.721655:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:2364:x1874219304543488:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 182us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.721662:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00010000:00010000:1.0:1787395061.722116:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.722133:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395061.722348:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787395061.722484:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787395061.722525:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787395061.722771:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323424768:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787395061.722826:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395061.722891:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395061.723778:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323424768 00000100:00100000:3.0:1787395061.723802:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323424768 00000100:00100000:3.0:1787395061.723891:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787395061.723900:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323424768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787395061.723996:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323424768:12345-0@lo:1000:mdt00_001.0 Request processed in 97us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.724003:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787395061.724060:0:5803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787395061.724066:0:5803:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787395061.724098:0:5803:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0b34100b100 x1874219323424000/t4294967309(4294967309) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787395077 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395061.724111:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323424768:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787395061.724577:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787395061.724642:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323424896:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787395061.724674:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395061.725259:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395061.725297:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323424896 00000100:00100000:0.0:1787395061.725303:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323424896 00000100:00100000:0.0:1787395061.725406:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787395061.725413:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323424896:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787395061.725663:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5803:x1874219323424896:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (986us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787395061.725670:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787395061.725756:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323424896:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787395061.725789:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725798:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725808:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725812:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.725816:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725823:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725837:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517400) 00010000:00010000:1.0:1787395061.725840:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395061.725844:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725850:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8848 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725877:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725895:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725901:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725905:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.725907:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725913:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725921:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.725923:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395061.725929:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725939:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.725946:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.726042:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.726055:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323425024:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395061.726249:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395061.729148:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.729657:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304543616 00000100:00100000:2.0:1787395061.729667:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304543616 00000100:00100000:2.0:1787395061.729725:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:2.0:1787395061.729734:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10534:x1874219304543616:12345-192.168.203.16@tcp:49:lfs.0 00000100:00100000:2.0:1787395061.729867:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10534:x1874219304543616:12345-192.168.203.16@tcp:49:lfs.0 Request processed in 133us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.729898:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1787395061.732019:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323425024:192.168.203.16@tcp:105: 00010000:00010000:3.0:1787395061.732050:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732059:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a878b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732104:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732117:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732137:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732146:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732152:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732159:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732165:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395061.732180:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732188:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732200:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395061.732203:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395061.732206:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732212:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a884f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732223:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732229:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732235:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732240:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395061.732242:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732248:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732255:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395061.732258:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787395061.732271:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.732277:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8841 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.732698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395061.732815:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+18:10535:x1874219304543360:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 14976us (15144us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787395061.732825:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 127 00000020:00080000:3.0:1787395061.732831:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787395061.732853:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304543872 00000100:00100000:3.0:1787395061.732859:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304543872 00000100:00100000:3.0:1787395061.732898:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:3.0:1787395061.732905:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+18:10534:x1874219304543872:12345-192.168.203.16@tcp:58:lfs.0 00000040:00080000:3.0:1787395061.733503:0:11555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787395061.733549:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+18:10534:x1874219304543872:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 643us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395061.733557:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:2.0:1787395061.739699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000040:00080000:0.0:1787395061.740793:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395061.740800:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395061.740859:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787395061.740866:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395061.741277:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323425152:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395061.741573:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1480 going to sleep for 11 seconds 00000100:00100000:1.0:1787395061.741841:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304544128 00000100:00100000:1.0:1787395061.741850:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304544128 00000100:00100000:1.0:1787395061.741904:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1787395061.741913:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:10535:x1874219304544128:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787395061.742609:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787395061.743462:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787395061.743527:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.743546:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.743946:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.743957:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.744100:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.744107:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.744143:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395061.744740:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395061.744749:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.744757:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395061.744761:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.744770:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.744783:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa0b318517900) 00010000:00010000:3.0:1787395061.744798:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787395061.744803:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.744809:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395061.744831:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395061.744833:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395061.744835:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395061.745466:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:10535:x1874219304544128:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 3547us (5769us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787395061.745478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000020:00080000:1.0:1787395061.745494:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787395061.755284:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323425152:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787395061.760883:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.765249:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304544256 00000100:00100000:1.0:1787395061.765266:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304544256 00000100:00100000:1.0:1787395061.765457:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:1.0:1787395061.765469:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+20:10536:x1874219304544256:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787395061.765500:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787395061.765848:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+20:10536:x1874219304544256:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 380us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.765857:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:2.0:1787395061.768001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.768051:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304544384 00000100:00100000:0.0:1787395061.768060:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304544384 00000100:00100000:0.0:1787395061.768121:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 130 00000100:00100000:0.0:1787395061.768143:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+20:10538:x1874219304544384:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395061.768168:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395061.768188:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a885d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2381 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768252:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768268:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768282:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768331:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768340:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768363:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768661:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768673:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768690:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768951:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395061.768967:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 21 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.768982:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323425280:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395061.769071:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395061.770675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.770753:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304544640 00000100:00100000:1.0:1787395061.770762:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304544640 00000100:00100000:1.0:1787395061.770818:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 131 00000100:00100000:1.0:1787395061.770828:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+22:10536:x1874219304544640:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.770845:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395061.771097:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8879 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2388 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771528:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128400/0xedbabbe2e89a8880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771548:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128400/0xedbabbe2e89a8880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771559:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128400/0xedbabbe2e89a8880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395061.771570:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787395061.771711:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8879 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2388 expref: 25 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771730:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128400/0xedbabbe2e89a8880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2388 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771739:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.771742:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787395061.771745:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771752:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.771760:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128400, rc 0) 00000100:00100000:1.0:1787395061.771825:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+24:10536:x1874219304544640:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 998us (1157us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1787395061.771834:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 131 00000100:00100000:0.0:1787395061.775624:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323425280:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395061.775651:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395061.776478:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.776630:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304544896 00000100:00100000:0.0:1787395061.776638:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304544896 00000100:00100000:0.0:1787395061.776690:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:0.0:1787395061.776699:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+24:5577:x1874219304544896:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787395061.776920:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+25:5577:x1874219304544896:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 221us (443us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787395061.776927:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:2.0:1787395061.777604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395061.777889:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545152 00000100:00100000:1.0:1787395061.777896:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545152 00000100:00100000:1.0:1787395061.778101:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 132 00000100:00100000:1.0:1787395061.778110:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+25:10536:x1874219304545152:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787395061.778181:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778197:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778209:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778449:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778458:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778464:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778470:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395061.778475:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778482:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778496:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.778499:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787395061.778504:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.778509:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a888e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395061.778662:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+26:10536:x1874219304545152:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 553us (1059us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787395061.778670:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 132 00000040:00080000:0.0:1787395061.779221:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395061.779226:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395061.779817:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787395061.779827:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787395061.782706:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395061.782748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395061.782836:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545536 00000100:00100000:0.0:1787395061.782844:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545536 00000100:00100000:0.0:1787395061.782899:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:0.0:1787395061.782909:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:10536:x1874219304545536:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787395061.783303:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545280 00000100:00100000:1.0:1787395061.783375:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545280 00010000:00010000:1.0:1787395061.783402:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 28 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395061.783763:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+28:10536:x1874219304545536:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 854us (1012us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787395061.783772:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:1.0:1787395061.783880:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:1.0:1787395061.783889:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+27:2363:x1874219304545280:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395061.783900:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395061.783907:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 27 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.783919:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 27 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.783942:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a877d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2342 expref: 27 pid: 11555 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.783956:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:1.0:1787395061.783962:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.783971:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.783978:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395061.784008:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395061.784030:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+26:2363:x1874219304545280:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 142us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395061.784037:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00010000:00010000:2.0:1787395061.784133:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784141:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395061.784175:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787395061.784180:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395061.784196:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784209:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784219:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784226:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784233:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784247:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395061.784252:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784259:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784269:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:2.0:1787395061.784271:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395061.784275:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784282:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784293:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784300:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784339:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784344:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395061.784347:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784353:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784373:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa0b318946200) 00010000:00010000:2.0:1787395061.784376:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395061.784379:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784385:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a886b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784433:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a885d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2381 expref: 26 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784447:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2381 expref: 25 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395061.784454:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395061.784456:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395061.784458:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010400, rc 0) 00000100:00100000:2.0:1787395061.784481:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+25:10538:x1874219304544384:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 16342us (16489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395061.784489:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 130 00010000:00010000:2.0:1787395062.230112:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787395062.647536:0:11961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787395062.647545:0:11961:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787395062.647589:0:11961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787395062.647594:0:11961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787395062.663243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395062.663487:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395062.663514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395062.663536:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395062.663575:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395062.663604:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546176 00000100:00100000:3.0:1787395062.663613:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546176 00000100:00100000:3.0:1787395062.663679:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545792 00000100:00100000:3.0:1787395062.663682:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545792 00000100:00100000:3.0:1787395062.663709:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:3.0:1787395062.663719:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304546176:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395062.663800:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304546176:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395062.663808:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:3.0:1787395062.663831:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:3.0:1787395062.663843:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:2363:x1874219304545792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395062.663898:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:2363:x1874219304545792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 55us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395062.663928:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:3.0:1787395062.663976:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545920 00000100:00100000:3.0:1787395062.663984:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545920 00000100:00100000:3.0:1787395062.664011:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546048 00000100:00100000:3.0:1787395062.664014:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546048 00000100:00100000:3.0:1787395062.664034:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:3.0:1787395062.664040:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304545920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395062.664067:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304545920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395062.664074:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:3.0:1787395062.664100:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:3.0:1787395062.664106:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304546048:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395062.664139:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304546048:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395062.664145:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00080000:3.0:1787395062.664170:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395062.664174:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787395062.664176:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395062.665246:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304545664 00000100:00100000:0.0:1787395062.665254:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304545664 00000100:00100000:3.0:1787395062.665591:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 283 00000100:00100000:3.0:1787395062.665605:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304545664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395062.665713:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304545664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 112us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395062.665721:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 283 00000100:00100000:0.0:1787395062.797050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395062.801223:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546432 00000100:00100000:2.0:1787395062.801238:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546432 00000100:00100000:2.0:1787395062.801429:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 133 00000100:00100000:2.0:1787395062.801450:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+25:10561:x1874219304546432:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395062.801471:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395062.801492:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8895 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc238f expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.801592:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a889c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.801608:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a889c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.801619:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a889c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395062.801629:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787395062.801744:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8895 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc238f expref: 28 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.801759:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a889c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc238f expref: 27 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.801767:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395062.801770:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787395062.801774:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49a00, rc 0) 00000100:00100000:2.0:1787395062.801836:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+27:10561:x1874219304546432:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 388us (4795us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787395062.801842:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 133 00000100:00100000:1.0:1787395062.818758:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395062.821455:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546560 00000100:00100000:2.0:1787395062.821471:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546560 00000100:00100000:2.0:1787395062.821591:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:2.0:1787395062.821602:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+27:10561:x1874219304546560:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:2.0:1787395062.821669:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821688:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821700:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821726:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821733:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821740:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821746:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395062.821750:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821756:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821766:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:2.0:1787395062.821769:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395062.821772:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395062.821788:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a88aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395062.821865:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+27:10561:x1874219304546560:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 265us (3116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395062.821874:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:3.0:1787395062.920231:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395062.921243:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546688 00000100:00100000:1.0:1787395062.921254:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546688 00000100:00100000:1.0:1787395062.921420:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787395062.921432:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304546688:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:1.0:1787395062.921449:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395062.921470:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ad89ee3/0xedbabbe2e89a88b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2396 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787395062.921498:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a897bf5, atime: 0x6a897bf5, ctime: 0x6a897bf5, blocks: 0xb 00010000:00010000:1.0:1787395062.921518:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1787395062.921522:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395062.921531:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad89ee3/0xedbabbe2e89a88b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2396 expref: 7 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395062.921549:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ad89ee3/0xedbabbe2e89a88b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2396 expref: 7 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395062.921561:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129a00, rc 0) 00000100:00100000:1.0:1787395062.922130:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304546688:12345-192.168.203.16@tcp:101:cat.0 Request processed in 684us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395062.922139:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787395062.927755:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395062.928205:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546816 00000100:00100000:2.0:1787395062.928215:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546816 00002000:00100000:2.0:1787395062.928265:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffffa0b33f4ff480 x1874219304546816/t0(0) o3->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1787395073 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395062.928275:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f4ff480 with x1874219304546816 ext(0->4095) 00002000:00010000:2.0:1787395062.928281:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33f4ff480 00000100:00100000:2.0:1787395062.928412:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:2.0:1787395062.928423:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304546816:12345-192.168.203.16@tcp:3:cat.0 00000100:00100000:2.0:1787395062.928667:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304546816:12345-192.168.203.16@tcp:3:cat.0 Request processed in 244us (920us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787395062.928675:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00002000:00100000:2.0:1787395062.928681:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffffa0b33f4ff480 x1874219304546816/t0(0) o3->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1787395073 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395062.928688:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f4ff480 with x1874219304546816 ext(0->4095) 00002000:00010000:2.0:1787395062.928692:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33f4ff480 00010000:00010000:3.0:1787395063.250939:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395064.274480:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787395064.403292:0:6965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336351982801ns, next at 337351980214ns, rc = 0 00000100:00100000:2.0:1787395064.403343:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787395064.403363:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323425408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787395064.403453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395064.403576:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323425408 00000100:00100000:1.0:1787395064.403585:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323425408 00000100:00100000:1.0:1787395064.403658:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787395064.403667:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323425408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787395064.403711:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395064.403756:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323425408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395064.403764:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1787395064.403905:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395064.403944:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323425408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395064.915805:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787395064.915829:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323425920:0@lo:400:kworker.0 00000100:00100000:1.0:1787395064.915848:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323425792:0@lo:400:kworker.0 00000100:00100000:1.0:1787395064.915903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395064.915915:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323426048:0@lo:400:kworker.0 00000100:00100000:0.0:1787395064.915930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395064.915968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395064.916011:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426048 00000100:00100000:3.0:1787395064.916015:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323425664:0@lo:400:kworker.0 00000100:00100000:2.0:1787395064.916019:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426048 00000100:00100000:3.0:1787395064.916050:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395064.916083:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787395064.916094:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323426048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395064.916110:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323425792 00000100:00100000:3.0:1787395064.916116:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323425792 00000100:00100000:3.0:1787395064.916148:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323425920 00000100:00100000:3.0:1787395064.916151:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323425920 00000100:00100000:2.0:1787395064.916161:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323426048:12345-0@lo:400:kworker.0 Request processed in 69us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395064.916175:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323425664 00000100:00100000:2.0:1787395064.916175:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787395064.916181:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323425664 00000100:00100000:3.0:1787395064.916202:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787395064.916207:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395064.916211:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323425792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787395064.916214:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395064.916234:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787395064.916243:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323425920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395064.916289:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323425920:12345-0@lo:400:kworker.0 Request processed in 48us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395064.916296:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787395064.916337:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787395064.916345:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323425664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395064.916379:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323425664:12345-0@lo:400:kworker.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395064.916385:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787395064.916421:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323425664:0@lo:400:kworker.0 00000100:00100000:2.0:1787395064.916470:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323426048:0@lo:400:kworker.0 00000100:00100000:3.0:1787395064.917073:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323425792:12345-0@lo:400:kworker.0 Request processed in 862us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395064.917081:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787395064.917383:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323425920:0@lo:400:kworker.0 00000100:00100000:0.0:1787395064.917403:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323425536:0@lo:400:kworker.0 00000100:00100000:0.0:1787395064.917438:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395064.917535:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323425536 00000100:00100000:2.0:1787395064.917540:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323425536 00000100:00100000:2.0:1787395064.917581:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1787395064.917589:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323425536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395064.917632:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323425536:12345-0@lo:400:kworker.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395064.917639:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787395064.917717:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323425536:0@lo:400:kworker.0 00000100:00100000:1.0:1787395064.918471:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323425792:0@lo:400:kworker.0 00010000:00010000:2.0:1787395065.298472:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395065.427081:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395065.427112:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323426176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395065.427182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395065.428574:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426176 00000100:00100000:1.0:1787395065.428586:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426176 00000100:00100000:0.0:1787395065.428672:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787395065.428683:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323426176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395065.428721:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395065.428882:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323426176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395065.428890:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787395065.436213:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323426176:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787395065.524135:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787395065.524154:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:3.0:1787395066.331463:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787395067.037017:0:11868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:0.0:1787395067.037038:0:11868:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1787395067.037071:0:11868:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b2022d06c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787395067.037075:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b329105e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b302469cc0 00000020:00080000:0.0:1787395067.037078:0:11868:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b308c5b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b3012aac00 00000004:00080000:0.0:1787395067.037101:0:11868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:0.0:1787395067.037114:0:11868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000100:00100000:0.0:1787395067.037617:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323426304:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1787395067.037700:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787395067.037935:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787395067.039047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395067.039125:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426304 00000100:00100000:0.0:1787395067.039133:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426304 00000100:00100000:0.0:1787395067.039182:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787395067.039191:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323426304:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787395067.040345:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787395067.040505:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787395067.040511:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787395061 -> 1787395061 00002000:00010000:0.0:1787395067.040519:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1787395061 -> 1787395061 00002000:00010000:0.0:1787395067.040522:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787395061 -> 1787395061 00002000:00010000:0.0:1787395067.040524:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787395067.040590:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1874219323426304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1398us (1544us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787395067.040600:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1787395067.040649:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b32926e680/2, rc 0, transno 4294967312 00000100:00100000:0.0:1787395067.040655:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323426304:0@lo:2:osp-syn-0-0.0 00000001:00080000:2.0:1787395067.047135:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787395067.047227:0:11870:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1787395067.284366:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395067.284790:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304546944 00000100:00100000:2.0:1787395067.284799:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304546944 00000100:00100000:2.0:1787395067.284914:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 135 00000100:00100000:2.0:1787395067.284924:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:10214:x1874219304546944:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787395067.285026:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:10214:x1874219304546944:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 Request processed in 104us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395067.285034:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 135 00000100:00080000:0.0:1787395067.285666:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395067.289392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395067.290359:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547200 00000100:00100000:0.0:1787395067.290371:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547200 00000100:00100000:0.0:1787395067.290434:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:0.0:1787395067.290444:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:10214:x1874219304547200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787395067.292593:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+15:10214:x1874219304547200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 2142us (3200us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787395067.292606:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00010000:00010000:3.0:1787395067.346525:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395067.731972:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395067.732377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547328 00000100:00100000:3.0:1787395067.732389:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547328 00000100:00100000:3.0:1787395067.732537:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00100000:3.0:1787395067.732548:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:11014:x1874219304547328:12345-192.168.203.16@tcp:101:lsof.0 00010000:00010000:3.0:1787395067.732568:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395067.732589:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a88b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc239d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.732650:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.732681:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.732692:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395067.732894:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787395067.732899:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395067.732990:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.733015:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a88b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.733031:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395067.733051:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:3.0:1787395067.733054:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395067.733058:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55dc00, rc 0) 00000100:00100000:3.0:1787395067.733141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:11014:x1874219304547328:12345-192.168.203.16@tcp:101:lsof.0 Request processed in 595us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395067.733149:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00080000:0.0:1787395067.737077:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395067.777847:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395067.777895:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395067.777937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395067.778032:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547456 00000100:00100000:0.0:1787395067.778040:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547456 00000100:00100000:0.0:1787395067.778108:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 285 00000100:00100000:0.0:1787395067.778118:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304547456:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395067.778188:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304547456:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395067.778195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 285 00000100:00100000:1.0:1787395067.778490:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547584 00000100:00100000:1.0:1787395067.778495:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547584 00000100:00100000:1.0:1787395067.778542:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547712 00000100:00100000:1.0:1787395067.778545:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547712 00000100:00100000:1.0:1787395067.778566:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:1.0:1787395067.778573:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304547584:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395067.778617:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304547584:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 43us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395067.778623:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:1.0:1787395067.778654:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:1.0:1787395067.778660:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304547712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395067.778687:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304547712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395067.778694:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00080000:0.0:1787395067.779065:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395067.779076:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787395068.373347:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395069.395043:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395069.523649:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787395069.523687:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323426432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395069.523757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395069.525036:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426432 00000100:00100000:1.0:1787395069.525047:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426432 00000100:00100000:1.0:1787395069.525407:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787395069.525420:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323426432:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787395069.525917:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787395069.525968:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395069.526050:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323426432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 632us (2290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395069.526058:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787395069.526591:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787395069.527224:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b34100b100, transno 4294967309 00000004:00080000:3.0:1787395069.527246:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1787395069.527277:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0b32926e680 x1874219323426304/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787395083 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395069.530145:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323426432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395070.034952:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323426816:0@lo:400:kworker.0 00000100:00100000:1.0:1787395070.035079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395070.035120:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323426944:0@lo:400:kworker.0 00000100:00100000:1.0:1787395070.035143:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395070.035152:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323426688:0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.035158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395070.035189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395070.035191:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787395070.035199:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323426560:0@lo:400:kworker.0 00000100:00100000:1.0:1787395070.035226:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426816 00000100:00100000:1.0:1787395070.035233:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426816 00000100:00100000:0.0:1787395070.035234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395070.035281:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323427072:0@lo:400:kworker.0 00000100:00100000:1.0:1787395070.035288:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426944 00000100:00100000:1.0:1787395070.035292:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426944 00000100:00100000:0.0:1787395070.035343:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395070.035350:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426688 00000100:00100000:1.0:1787395070.035355:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426688 00000100:00100000:0.0:1787395070.035378:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323426560 00000100:00100000:1.0:1787395070.035380:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787395070.035384:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323426560 00000100:00100000:1.0:1787395070.035392:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323426816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.035436:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787395070.035443:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323426560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.035482:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323426560:12345-0@lo:400:kworker.0 Request processed in 39us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395070.035489:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787395070.035532:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323426560:0@lo:400:kworker.0 00000100:00100000:2.0:1787395070.035614:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787395070.035623:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323426944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395070.035663:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323426944:12345-0@lo:400:kworker.0 Request processed in 41us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395070.035670:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787395070.035684:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787395070.035703:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323426688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395070.035812:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323426944:0@lo:400:kworker.0 00000100:00100000:1.0:1787395070.035859:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323426816:12345-0@lo:400:kworker.0 Request processed in 469us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395070.035873:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:0.0:1787395070.041684:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395070.041716:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427072 00000100:00100000:0.0:1787395070.041728:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427072 00000100:00100000:0.0:1787395070.041803:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787395070.041813:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323427072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.041909:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323427072:12345-0@lo:400:kworker.0 Request processed in 98us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395070.041917:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787395070.041936:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395070.045849:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323426688:12345-0@lo:400:kworker.0 Request processed in 10135us (10649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395070.045864:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787395070.046253:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787395070.046260:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787395070.046282:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b341009180, transno 4294967304 00000100:00100000:3.0:1787395070.046323:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323427072:0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.056111:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323426688:0@lo:400:kworker.0 00000100:00100000:0.0:1787395070.056147:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323426816:0@lo:400:kworker.0 00010000:00010000:3.0:1787395070.418842:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395070.547148:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787395070.547350:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323427200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395070.547415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395070.552775:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427200 00000100:00100000:2.0:1787395070.552789:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427200 00000100:00100000:2.0:1787395070.552847:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787395070.552858:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323427200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395070.552894:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395070.552997:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323427200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (5581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395070.553005:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787395070.553046:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323427200:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787395070.994663:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395070.994674:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395070.995513:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787395070.995520:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787395071.445007:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787395071.723760:0:12164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:37:50 (1787395070) 00000001:00080000:2.0:1787395072.147501:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787395072.147522:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787395072.147618:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787395072.147633:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1787395072.148398:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1787395072.466604:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395072.899244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395072.899381:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395072.899419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395072.899467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395072.899504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395072.899567:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548096 00000100:00100000:3.0:1787395072.899580:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548096 00000100:00100000:3.0:1787395072.899642:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548224 00000100:00100000:3.0:1787395072.899646:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548224 00000100:00100000:3.0:1787395072.899675:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395072.899690:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304548096:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395072.899816:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2365:x1874219304548096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 126us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395072.899829:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395072.899857:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1787395072.899869:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304548224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395072.899935:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+5:2365:x1874219304548224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 67us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395072.899946:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:1.0:1787395072.900098:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548352 00000100:00100000:1.0:1787395072.900103:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548352 00000100:00100000:1.0:1787395072.900138:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547968 00000100:00100000:1.0:1787395072.900141:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547968 00000100:00100000:1.0:1787395072.900161:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 133 00000100:00100000:1.0:1787395072.900168:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+6:2365:x1874219304548352:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395072.900201:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+6:2365:x1874219304548352:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395072.900207:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 133 00000100:00100000:1.0:1787395072.900219:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:1.0:1787395072.900225:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+14:2365:x1874219304547968:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395072.900253:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+14:2365:x1874219304547968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (785us total) trans 0 rc 0/0 00000100:00080000:0.0:1787395072.900255:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395072.900259:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00080000:0.0:1787395072.900273:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395072.900276:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395072.914112:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304547840 00000100:00100000:2.0:1787395072.914129:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304547840 00000100:00100000:2.0:1787395072.914196:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 287 00000100:00100000:2.0:1787395072.914206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304547840:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395072.914366:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304547840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 160us (15130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395072.914375:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 287 00010000:00010000:3.0:1787395073.490624:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395073.905909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395073.906106:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548608 00000100:00100000:2.0:1787395073.906116:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548608 00000100:00100000:2.0:1787395073.906187:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 137 00000100:00100000:2.0:1787395073.906198:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+14:11279:x1874219304548608:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395073.906234:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395073.906297:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a88c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23a4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906418:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906431:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906442:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906472:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906479:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906486:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906868:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a88db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906877:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a88db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.906884:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a88db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395073.906894:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787395073.907087:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907094:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907100:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907105:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395073.907109:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907117:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907127:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:2.0:1787395073.907131:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395073.907135:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907141:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a88cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907152:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907158:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907163:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907177:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395073.907179:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907185:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907192:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395073.907195:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395073.907197:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907203:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a88d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907600:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a88c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23a4 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907613:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a88db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23a4 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395073.907619:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:2.0:1787395073.907621:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395073.907624:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49200, rc 0) 00000100:00100000:2.0:1787395073.907699:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+16:11279:x1874219304548608:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1502us (1800us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787395073.907707:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 137 00000100:00100000:1.0:1787395073.912156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395073.912304:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548736 00000100:00100000:2.0:1787395073.912358:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548736 00000100:00100000:2.0:1787395073.912421:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:2.0:1787395073.912431:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:11279:x1874219304548736:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787395073.912523:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:11279:x1874219304548736:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 Request processed in 93us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395073.912530:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:3.0:1787395073.917561:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395073.917631:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548864 00000100:00100000:0.0:1787395073.917641:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548864 00000100:00100000:0.0:1787395073.917710:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395073.917721:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+16:2363:x1874219304548864:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395073.917735:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395073.917760:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a88db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23a4 expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395073.917785:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:0.0:1787395073.917790:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395073.917856:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+15:2363:x1874219304548864:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 138us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395073.917864:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000040:00080000:1.0:1787395074.066544:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395074.066561:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395074.066602:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787395074.066610:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787395074.515647:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395074.646857:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323427328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395074.646928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395074.647022:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427328 00000100:00100000:2.0:1787395074.647030:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427328 00000100:00100000:2.0:1787395074.647102:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787395074.647111:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323427328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395074.647148:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787395074.651104:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395074.651404:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323427328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4286us (4467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395074.651417:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787395074.651604:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787395074.651612:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b32926e680, transno 4294967312 00000100:00100000:1.0:1787395074.651640:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323427328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395075.165467:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323427584:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.165583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.165662:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323428096:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.165747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.165794:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787395075.165814:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323427456:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.165859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.165998:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323427968:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.166096:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323427712:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166129:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.166161:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395075.166167:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323427840:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395075.166232:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427584 00000100:00100000:0.0:1787395075.166239:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427584 00000100:00100000:0.0:1787395075.166301:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427968 00000100:00100000:0.0:1787395075.166336:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427968 00000100:00100000:0.0:1787395075.166385:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427712 00000100:00100000:0.0:1787395075.166388:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427712 00000100:00100000:0.0:1787395075.166418:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787395075.166426:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323427584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166489:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323427584:12345-0@lo:400:kworker.0 Request processed in 63us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.166509:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787395075.166539:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787395075.166545:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323427968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166612:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323427968:12345-0@lo:400:kworker.0 Request processed in 66us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.166618:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787395075.166653:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787395075.166672:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323427712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.166720:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323427712:12345-0@lo:400:kworker.0 Request processed in 61us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.166737:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787395075.166768:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323428096 00000100:00100000:0.0:1787395075.166773:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323428096 00000100:00100000:0.0:1787395075.166811:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427840 00000100:00100000:0.0:1787395075.166814:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427840 00000100:00100000:0.0:1787395075.166862:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787395075.166869:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323428096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787395075.166914:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787395075.166919:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395075.166936:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787395075.166945:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323427840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395075.166981:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323427840:12345-0@lo:400:kworker.0 Request processed in 38us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.166987:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787395075.167010:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323427456 00000100:00100000:1.0:1787395075.167014:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323427456 00000100:00100000:1.0:1787395075.167053:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787395075.167060:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323427456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395075.167090:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323427456:12345-0@lo:400:kworker.0 Request processed in 31us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.167096:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1787395075.167149:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323427840:0@lo:400:kworker.0 00000100:00100000:1.0:1787395075.167161:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323427712:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.167187:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323428096:12345-0@lo:400:kworker.0 Request processed in 318us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.167194:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323427456:0@lo:400:kworker.0 00000100:00100000:0.0:1787395075.167206:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787395075.167216:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323427968:0@lo:400:kworker.0 00000100:00100000:1.0:1787395075.167225:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323427584:0@lo:400:kworker.0 00000100:00100000:1.0:1787395075.167236:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323428096:0@lo:400:kworker.0 00010000:00010000:3.0:1787395075.538471:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395075.667856:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323428224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395075.667927:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395075.667999:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323428224 00000100:00100000:3.0:1787395075.668007:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323428224 00000100:00100000:3.0:1787395075.668075:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787395075.668086:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323428224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787395075.668120:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395075.668178:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323428224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395075.668185:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787395075.668280:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323428224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395075.730926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.731085:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304548992 00000100:00100000:0.0:1787395075.731095:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304548992 00000100:00100000:0.0:1787395075.731177:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 139 00000100:00100000:0.0:1787395075.731188:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+15:11321:x1874219304548992:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395075.731209:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395075.731270:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a88e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23ab expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731357:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731372:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731384:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731413:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731420:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.731427:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395075.731985:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787395075.732773:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732786:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732792:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732798:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395075.732916:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732926:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732940:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:0.0:1787395075.732944:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395075.732948:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732954:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a88f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732975:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732990:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.732997:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733002:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395075.733004:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733010:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733018:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0b318946d00) 00010000:00010000:0.0:1787395075.733020:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395075.733023:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733037:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a88f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733076:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a88e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ab expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733086:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:0.0:1787395075.733089:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395075.733099:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a88e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ab expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.733109:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010a00, rc 0) 00000100:00100000:0.0:1787395075.733179:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+15:11321:x1874219304548992:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1993us (2317us total) trans 0 rc 301/301 00000100:00100000:0.0:1787395075.733187:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 139 00000100:00100000:2.0:1787395075.743566:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395075.743690:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304549248 00000100:00100000:1.0:1787395075.743701:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304549248 00000100:00100000:1.0:1787395075.743795:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 140 00000100:00100000:1.0:1787395075.743806:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+15:11321:x1874219304549248:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:1.0:1787395075.743865:0:11555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395075.743894:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8267 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21e4 expref: 15 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.743913:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:1.0:1787395075.743918:0:11555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395075.744211:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.744225:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.744234:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.744280:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.744294:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 5 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395075.744398:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323428352:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395075.744499:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787395075.747141:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3396b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323428352:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395075.747161:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:1.0:1787395075.747174:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395075.747366:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304549376 00000100:00100000:0.0:1787395075.747381:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304549376 00010000:00010000:0.0:1787395075.747436:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 6 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395075.747471:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:0.0:1787395075.747480:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:2363:x1874219304549376:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395075.747495:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395075.747502:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 6 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747513:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 6 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747537:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a88bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc239d expref: 6 pid: 5804 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747553:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:0.0:1787395075.747558:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747586:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747593:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.747626:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395075.747671:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304549376:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 191us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.747679:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00010000:00010000:2.0:1787395075.747775:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.747782:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.747806:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.747814:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.747821:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395075.749542:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787395075.749829:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787395075.749844:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.749853:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.749860:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.750570:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395075.750576:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.750586:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.750604:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b308bf3500) 00010000:00010000:2.0:1787395075.750607:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395075.750611:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.750617:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a88fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395075.750642:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c921f40d reply state 00000000daaa92af transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395075.750651:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395075.750738:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+16:11321:x1874219304549248:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 6932us (7180us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787395075.750760:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 140 00010000:00010000:2.0:1787395075.755182:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755201:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755210:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755216:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395075.755221:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755230:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755246:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0b3112e7400) 00010000:00010000:2.0:1787395075.755249:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395075.755253:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.755259:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8905 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395075.863148:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.863487:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304549504 00000100:00100000:0.0:1787395075.863497:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304549504 00000100:00100000:0.0:1787395075.863565:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:0.0:1787395075.863582:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+15:11329:x1874219304549504:12345-192.168.203.16@tcp:101:lctl.0 00010000:00010000:0.0:1787395075.863624:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395075.863653:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a890c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23b2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.863755:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.863768:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.863780:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395075.863858:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787395075.863868:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395075.863946:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.863979:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a890c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b2 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.863999:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b2 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.864014:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:0.0:1787395075.864017:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787395075.864021:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011200, rc 0) 00000100:00100000:0.0:1787395075.864200:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+16:11329:x1874219304549504:12345-192.168.203.16@tcp:101:lctl.0 Request processed in 619us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.864209:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:1.0:1787395075.954369:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.954464:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304549632 00000100:00100000:0.0:1787395075.954473:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304549632 00000100:00100000:0.0:1787395075.954534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:0.0:1787395075.954545:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+16:11335:x1874219304549632:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395075.954564:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395075.954582:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a891a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23b9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954644:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954657:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954669:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954697:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954704:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954711:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954820:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954829:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954836:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395075.954876:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787395075.954880:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395075.954903:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954914:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954925:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954932:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954948:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395075.954952:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954959:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954971:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:0.0:1787395075.954974:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395075.954979:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954985:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8921 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.954998:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955003:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955008:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955014:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395075.955016:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955021:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955052:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa0b318946500) 00010000:00010000:0.0:1787395075.955054:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395075.955057:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955063:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8928 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955092:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a891a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b9 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955105:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b9 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.955111:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395075.955113:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787395075.955115:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010c00, rc 0) 00000100:00100000:0.0:1787395075.955181:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+17:11335:x1874219304549632:12345-192.168.203.16@tcp:101:bash.0 Request processed in 638us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395075.955189:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:3.0:1787395075.958617:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395075.958702:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304549888 00000100:00100000:2.0:1787395075.958712:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304549888 00000100:00100000:2.0:1787395075.958766:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 143 00000100:00100000:2.0:1787395075.958775:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+17:11335:x1874219304549888:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395075.958819:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395075.958839:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8936 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23c0 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.958978:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.958993:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959004:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959064:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959073:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959080:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787395075.959617:0:11555:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787395075.959775:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959785:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959792:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959834:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959841:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959847:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959853:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395075.959858:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959865:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959877:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395075.959880:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395075.959884:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959890:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a893d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395075.959904:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b9cde7d3 reply state 000000006f5b2974 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395075.959913:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787395075.959942:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8936 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 20 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959969:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 19 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.959976:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:2.0:1787395075.959979:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395075.959981:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395075.960059:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+20:11335:x1874219304549888:12345-192.168.203.16@tcp:101:bash.0 Request processed in 1284us (1451us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787395075.960068:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 143 00010000:00010000:2.0:1787395075.962225:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962241:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962248:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962254:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395075.962258:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962265:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962279:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395075.962282:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395075.962286:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395075.962327:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395075.969737:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395075.970244:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304550016 00000100:00100000:1.0:1787395075.970254:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304550016 00000100:00100000:1.0:1787395075.970408:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:1.0:1787395075.970418:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304550016:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395075.970437:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395075.970458:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23c7 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787395075.970487:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787395075.970508:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:1.0:1787395075.970513:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395075.970522:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 6 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.970569:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 6 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.970584:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128c00, rc 0) 00000100:00080000:0.0:1787395075.970721:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787395075.970775:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304550016:12345-192.168.203.16@tcp:101:bash.0 Request processed in 358us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.970782:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:1.0:1787395075.978238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.978344:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304550144 00000100:00100000:0.0:1787395075.978354:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304550144 00000100:00100000:1.0:1787395075.978635:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:1.0:1787395075.978648:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3396b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+6:11335:x1874219304550144:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395075.978665:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395075.978684:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23ce expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.978715:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.978724:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395075.978728:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395075.978733:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.978779:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.978811:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395075.978825:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323428480:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395075.978915:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787395075.981784:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323428480:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395075.981823:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.981845:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395075.981906:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3396b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:11335:x1874219304550144:12345-192.168.203.16@tcp:101:bash.0 Request processed in 3260us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.981915:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:3.0:1787395075.983523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.983660:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304550272 00000100:00100000:0.0:1787395075.983669:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304550272 00010000:00010000:0.0:1787395075.983708:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395075.983783:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:0.0:1787395075.983794:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304550272:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395075.983808:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395075.983832:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.984096:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.984122:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1326025/0xedbabbe2e89a8959 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c7 expref: 7 pid: 6601 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.984198:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395075.984202:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395075.984211:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395075.984221:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395075.984791:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395075.984807:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1874219323428608:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395075.985091:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f9149c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395075.990090:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1874219323428608:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787395075.990118:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395075.990216:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304550272:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 6422us (6698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395075.990227:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:2.0:1787395075.990416:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395075.990528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304550528 00000100:00100000:0.0:1787395075.990536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304550528 00000100:00100000:0.0:1787395075.990575:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:0.0:1787395075.990584:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:11335:x1874219304550528:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:0.0:1787395075.991770:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+20:11335:x1874219304550528:12345-192.168.203.16@tcp:35:bash.0 Request processed in 1182us (1350us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787395075.991779:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1787395076.178605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395076.178884:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304550784 00000100:00100000:2.0:1787395076.178899:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304550784 00000100:00100000:2.0:1787395076.179077:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 144 00000100:00100000:2.0:1787395076.179091:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+20:11345:x1874219304550784:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395076.179127:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395076.179160:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23d5 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395076.179371:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787395076.179532:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8967 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23d5 expref: 22 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.179552:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:2.0:1787395076.179555:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395076.179562:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23d5 expref: 22 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.179580:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:2.0:1787395076.179670:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+21:11345:x1874219304550784:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 583us (1953us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787395076.179679:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 144 00000100:00100000:1.0:1787395076.185581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395076.185685:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551040 00000100:00100000:3.0:1787395076.185720:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551040 00000100:00100000:3.0:1787395076.185795:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:3.0:1787395076.185807:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:11345:x1874219304551040:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395076.187685:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:11345:x1874219304551040:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 1864us (2103us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787395076.187701:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:1.0:1787395076.285917:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395076.286196:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551168 00000100:00100000:2.0:1787395076.286233:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551168 00000100:00100000:2.0:1787395076.286375:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 145 00000100:00100000:2.0:1787395076.286389:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+22:11351:x1874219304551168:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395076.286425:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395076.286453:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23dc expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286542:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286559:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286575:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395076.286663:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787395076.286669:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395076.286697:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286730:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23dc expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286753:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23dc expref: 23 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.286763:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395076.286767:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395076.286771:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48200, rc 0) 00000100:00100000:2.0:1787395076.286892:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+23:11351:x1874219304551168:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 507us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395076.286902:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 145 00000100:00100000:1.0:1787395076.294176:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.294372:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551424 00000100:00100000:0.0:1787395076.294387:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551424 00000100:00100000:0.0:1787395076.294471:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:0.0:1787395076.294485:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+23:11351:x1874219304551424:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395076.294518:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395076.294549:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23e3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.294693:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a898a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.294713:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a898a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.294729:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a898a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395076.294743:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787395076.295045:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23e3 expref: 26 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.295069:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a898a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23e3 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.295078:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:0.0:1787395076.295101:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395076.295106:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395076.295203:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+25:11351:x1874219304551424:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 721us (1045us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787395076.295212:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:3.0:1787395076.300479:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395076.302070:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551680 00000100:00100000:2.0:1787395076.302094:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551680 00000100:00100000:2.0:1787395076.302194:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 147 00000100:00100000:2.0:1787395076.302206:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:11351:x1874219304551680:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395076.302244:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395076.302274:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8998 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23ea expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.302440:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.302459:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.302474:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395076.302490:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787395076.302656:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8998 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ea expref: 28 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.302676:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ea expref: 27 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.302686:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:2.0:1787395076.302690:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787395076.302712:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:1.0:1787395076.302883:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+27:11351:x1874219304551680:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 676us (2421us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787395076.302893:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 147 00000100:00100000:1.0:1787395076.311167:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.311357:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551808 00000100:00100000:0.0:1787395076.311373:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551808 00000100:00100000:0.0:1787395076.311465:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787395076.311477:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:2364:x1874219304551808:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395076.311496:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395076.311530:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a898a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23e3 expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.311553:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:0.0:1787395076.311560:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395076.311646:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+26:2364:x1874219304551808:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 170us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395076.311655:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:3.0:1787395076.323257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395076.323745:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304551936 00000100:00100000:1.0:1787395076.323759:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304551936 00000100:00100000:1.0:1787395076.323847:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:1.0:1787395076.323859:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2363:x1874219304551936:12345-192.168.203.16@tcp:1:lfs.0 00010000:00010000:1.0:1787395076.323932:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.323958:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.323969:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787395076.323986:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395076.323993:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.324052:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.324070:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 6 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395076.324118:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323428736:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395076.324542:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787395076.330758:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323428736:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395076.330810:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395076.330819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.330924:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552064 00000100:00100000:0.0:1787395076.330934:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552064 00002000:00100000:0.0:1787395076.331011:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0b33f46ea00 x1874219304552064/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:537/0 lens 504/0 e 0 to 0 dl 1787395087 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395076.331032:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f46ea00 with x1874219304552064 ext(0->12) 00010000:00010000:0.0:1787395076.331042:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 7 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.331058:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 7 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395076.331085:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b33f46ea00 00000100:00100000:0.0:1787395076.331129:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787395076.331148:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304552064:12345-192.168.203.16@tcp:4:lfs.0 00000100:00100000:0.0:1787395076.331819:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304552064:12345-192.168.203.16@tcp:4:lfs.0 Request processed in 669us (1010us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787395076.331829:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00002000:00100000:0.0:1787395076.331836:0:6605:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa0b33f46ea00 x1874219304552064/t4294967305(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:537/0 lens 504/448 e 0 to 0 dl 1787395087 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395076.331845:0:6605:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f46ea00 with x1874219304552064 ext(0->12) 00010000:00010000:0.0:1787395076.331853:0:6605:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.331869:0:6605:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787395076.331877:0:6605:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffffa0b33f46ea00 00000100:00100000:2.0:1787395076.343932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395076.344047:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552192 00000100:00100000:1.0:1787395076.344061:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552192 00010000:00010000:1.0:1787395076.344119:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395076.344292:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:1.0:1787395076.344343:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:2365:x1874219304552192:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395076.344366:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787395076.344393:0:11522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787395076.344397:0:11522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787395076 00002000:00010000:1.0:1787395076.344399:0:11522:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787395076 00002000:00010000:1.0:1787395076.344402:0:11522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787395076 00010000:00010000:1.0:1787395076.344409:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.344427:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.344485:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079154a30/0xedbabbe2e89a8960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ce expref: 9 pid: 6602 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.344508:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395076.344513:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395076.344520:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.344532:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.344588:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395076.344668:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2365:x1874219304552192:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 367us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395076.344677:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00010000:00010000:3.0:1787395076.344752:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344765:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344796:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344805:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344813:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344820:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395076.344825:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344841:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.344854:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.345203:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064477cb/0xedbabbe2e89a89ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395076.345581:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304551936:12345-192.168.203.16@tcp:1:lfs.0 Request processed in 21440us (22055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395076.345593:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:3.0:1787395076.349396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.349543:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552448 00000100:00100000:0.0:1787395076.349558:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552448 00000100:00100000:0.0:1787395076.349633:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:0.0:1787395076.349645:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:11351:x1874219304552448:12345-192.168.203.16@tcp:35:lfs.0 00000004:00010000:0.0:1787395076.349737:0:5805:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ea expref: 26 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395076.350672:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787395076.350744:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787395076.355881:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787395076.356041:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.356069:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 30 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.356079:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.356135:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 30 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.356177:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 30 pid: 11555 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395076.356199:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1874219323428864:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395076.358584:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1840 going to sleep for 11 seconds 00000100:00100000:0.0:1787395076.366429:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395076.366581:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552576 00000100:00100000:3.0:1787395076.366594:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552576 00010000:00010000:3.0:1787395076.366647:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 31 pid: 11555 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395076.366699:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395076.366711:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+31:2364:x1874219304552576:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395076.366731:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395076.366739:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 31 pid: 11555 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.366756:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 31 pid: 11555 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.366803:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:3.0:1787395076.366810:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.366822:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.366830:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395076.366851:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395076.366924:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+31:2364:x1874219304552576:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 215us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395076.366933:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00010000:00010000:1.0:1787395076.371186:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a894b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23c0 expref: 30 pid: 11555 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395076.371222:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1874219323428864:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395076.371489:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.371502:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.371509:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395076.371695:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787395076.371963:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787395076.372140:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1874219323428992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787395076.372357:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395076.372407:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395076.372652:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323428992 00000100:00100000:3.0:1787395076.372662:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323428992 00000100:00100000:3.0:1787395076.372725:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787395076.372736:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874219323428992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787395076.372843:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874219323428992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395076.372853:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787395076.377723:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1874219323428992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787395076.378871:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787395076.378963:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1874219323429120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787395076.379164:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395076.379204:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1240 going to sleep for 11 seconds 00000100:00100000:3.0:1787395076.379758:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323429120 00000100:00100000:3.0:1787395076.379777:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323429120 00000100:00100000:3.0:1787395076.379832:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787395076.379841:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5805:x1874219323429120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787395076.380186:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1874219323429120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 345us (1021us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787395076.380218:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787395076.380414:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f4fc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1874219323429120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787395076.380474:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787395076.380531:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380542:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380550:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380556:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395076.380561:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380569:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380585:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:1.0:1787395076.380588:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787395076.380593:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.380599:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395076.380970:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787395076.381160:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1787395076.381170:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348329863165ns, next at 349329861201ns, rc = 0 00000001:00080000:1.0:1787395076.381186:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787395076.382840:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:1.0:1787395076.382848:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787395076.382858:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a899f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ea expref: 34 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395076.383166:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043be050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:11351:x1874219304552448:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 33513us (33777us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787395076.383183:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000020:00080000:2.0:1787395076.383191:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787395076.396834:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395076.396978:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552704 00000100:00100000:1.0:1787395076.397005:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552704 00000100:00100000:1.0:1787395076.397102:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 148 00000100:00100000:1.0:1787395076.397116:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+33:11351:x1874219304552704:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395076.397158:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395076.397192:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23f1 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.397290:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23f1 expref: 34 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.397356:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23f1 expref: 34 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.397381:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395076.397384:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395076.397390:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129600, rc 0) 00000100:00100000:1.0:1787395076.397489:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+34:11351:x1874219304552704:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 376us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395076.397497:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 148 00000100:00100000:0.0:1787395076.403804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395076.404623:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304552960 00000100:00100000:3.0:1787395076.404637:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304552960 00000100:00100000:3.0:1787395076.404713:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:3.0:1787395076.404726:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+34:11351:x1874219304552960:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395076.408811:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:11351:x1874219304552960:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 4070us (5004us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787395076.408829:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:2.0:1787395076.513221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.513374:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304553216 00000100:00100000:0.0:1787395076.513387:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304553216 00000100:00100000:0.0:1787395076.513485:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 149 00000100:00100000:0.0:1787395076.513500:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:11361:x1874219304553216:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395076.513538:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395076.513568:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a89c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23f8 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395076.513892:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787395076.514085:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a89c2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23f8 expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.514105:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:0.0:1787395076.514108:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395076.514114:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a89c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23f8 expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.514134:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395076.515211:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:11361:x1874219304553216:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1704us (1995us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787395076.515225:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 149 00000100:00100000:0.0:1787395076.521123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395076.521290:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304553344 00000100:00100000:1.0:1787395076.521332:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304553344 00000100:00100000:1.0:1787395076.521557:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 150 00000100:00100000:1.0:1787395076.521571:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+36:11361:x1874219304553344:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:1.0:1787395076.521678:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521699:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521713:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521732:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521739:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521746:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521879:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521888:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521896:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787395076.521950:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521964:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521991:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.521998:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522008:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395076.522013:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522029:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522043:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395076.522047:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395076.522057:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522064:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a89d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522082:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522088:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522093:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522098:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395076.522108:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522114:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522122:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318517300) 00010000:00010000:1.0:1787395076.522124:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395076.522127:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522132:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a89d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522152:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522159:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522165:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522170:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395076.522173:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522178:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522185:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395076.522187:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395076.522197:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.522203:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a89de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395076.522612:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+36:11361:x1874219304553344:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1041us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395076.522623:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 150 00000100:00100000:3.0:1787395076.525191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395076.525430:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304553600 00000100:00100000:3.0:1787395076.525442:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304553600 00000100:00100000:3.0:1787395076.525511:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:3.0:1787395076.525523:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+36:11361:x1874219304553600:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395076.525888:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+37:11361:x1874219304553600:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 366us (712us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787395076.525897:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00010000:00010000:3.0:1787395076.562658:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395076.577612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.577737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304553856 00000100:00100000:0.0:1787395076.577751:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304553856 00000100:00100000:0.0:1787395076.577855:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:0.0:1787395076.577876:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+37:11364:x1874219304553856:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395076.577907:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395076.577935:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a89e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc23ff expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578061:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578078:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578091:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578107:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578114:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578120:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578299:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578345:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578353:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395076.578379:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787395076.578520:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578529:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578535:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578542:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395076.578547:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578555:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578569:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395076.578572:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395076.578579:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578585:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a89ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578601:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578607:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578626:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578631:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395076.578634:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578640:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578648:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318946500) 00010000:00010000:0.0:1787395076.578652:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395076.578654:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578660:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a89f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578718:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a89e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578733:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.578741:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395076.578743:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395076.578746:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010200, rc 0) 00000100:00100000:0.0:1787395076.578854:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+39:11364:x1874219304553856:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 989us (1257us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787395076.578873:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:3.0:1787395076.583117:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395076.583229:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304553984 00000100:00100000:0.0:1787395076.583243:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304553984 00000100:00100000:0.0:1787395076.583365:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:0.0:1787395076.583378:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+39:11364:x1874219304553984:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:0.0:1787395076.583482:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583505:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583518:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583554:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583561:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583569:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583575:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395076.583580:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583588:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583600:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395076.583622:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395076.583628:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395076.583634:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395076.583732:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+39:11364:x1874219304553984:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 356us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395076.583742:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:3.0:1787395076.587472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395076.587717:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304554240 00000100:00100000:2.0:1787395076.587731:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304554240 00000100:00100000:2.0:1787395076.587810:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:2.0:1787395076.587822:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+39:11364:x1874219304554240:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395076.588192:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+40:11364:x1874219304554240:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 371us (735us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787395076.588202:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:3.0:1787395076.959907:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395076.960041:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304554496 00000100:00100000:1.0:1787395076.960055:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304554496 00000100:00100000:1.0:1787395076.960137:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00100000:1.0:1787395076.960149:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+40:11395:x1874219304554496:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:1.0:1787395076.960182:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395076.960209:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2406 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.960389:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8a16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.960407:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.960422:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8a16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395076.960435:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787395076.960615:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2406 expref: 43 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.960638:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8a16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2406 expref: 42 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395076.960666:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395076.960669:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395076.960674:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129200, rc 0) 00000100:00100000:1.0:1787395076.960762:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+42:11395:x1874219304554496:12345-192.168.203.16@tcp:101:cat.0 Request processed in 614us (868us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787395076.960770:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00100000:0.0:1787395076.971243:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395076.971548:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304554624 00000100:00100000:2.0:1787395076.971561:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304554624 00000100:00100000:2.0:1787395076.971919:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395076.971942:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3083a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+42:2363:x1874219304554624:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395076.971971:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395076.972006:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2406 expref: 42 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395076.972044:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395076.972051:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395076.972127:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3083a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+41:2363:x1874219304554624:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 190us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395076.972136:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:3.0:1787395076.972745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395076.973247:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304554880 00000100:00100000:3.0:1787395076.973256:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304554880 00000100:00100000:3.0:1787395076.973359:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:3.0:1787395076.973369:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+41:11395:x1874219304554880:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:3.0:1787395076.973782:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+42:11395:x1874219304554880:12345-192.168.203.16@tcp:35:cat.0 Request processed in 412us (1038us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787395076.973791:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:3.0:1787395077.061709:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.063116:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304555136 00000100:00100000:1.0:1787395077.063136:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304555136 00000100:00100000:1.0:1787395077.063252:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 154 00000100:00100000:1.0:1787395077.063268:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+42:11402:x1874219304555136:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1787395077.063299:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395077.063303:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787395077.063357:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a897c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23dc expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.063384:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395077.063390:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395077.063408:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc240d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.063553:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787395077.063677:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787395077.064453:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.064493:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.064545:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 42 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.064573:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 42 pid: 5804 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395077.064591:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323429248:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395077.064961:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395077.069033:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323429248:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395077.069079:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395077.087585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.087753:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304555264 00000100:00100000:1.0:1787395077.087775:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304555264 00010000:00010000:1.0:1787395077.087856:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 43 pid: 5804 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395077.087916:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:1.0:1787395077.087927:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+43:2363:x1874219304555264:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395077.088736:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395077.088755:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 43 pid: 5804 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088804:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 43 pid: 5804 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088838:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010200/0xedbabbe2e89a89fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23ff expref: 43 pid: 5804 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088861:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395077.088867:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088877:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088886:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.088929:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395077.089031:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+42:2363:x1874219304555264:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 1095us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395077.089043:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00010000:00010000:1.0:1787395077.089101:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.089110:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395077.089131:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787395077.089387:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.089424:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.089432:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395077.089436:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787395077.089439:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395077.089492:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+42:11402:x1874219304555136:12345-192.168.203.16@tcp:101:dd.0 Request processed in 26230us (27800us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787395077.089500:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 154 00000100:00100000:2.0:1787395077.094610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.094764:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304555520 00000100:00100000:1.0:1787395077.094775:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304555520 00000100:00100000:1.0:1787395077.094839:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 155 00000100:00100000:1.0:1787395077.094850:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+42:11402:x1874219304555520:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1787395077.095611:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.095631:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.095643:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395077.095694:0:11555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1787395077.095718:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009115850 reply state 000000002d26b7f4 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395077.095727:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395077.095843:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+45:11402:x1874219304555520:12345-192.168.203.16@tcp:36:dd.0 Request processed in 992us (1239us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1787395077.095851:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 155 00000020:00080000:1.0:1787395077.095857:0:11555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787395077.099374:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099393:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099400:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099406:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395077.099411:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099419:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099436:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395077.099439:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395077.099444:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.099469:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8a39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787395077.272238:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967435 is committed 00000001:00080000:2.0:1787395077.272269:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:2.0:1787395077.272280:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787395077.272340:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b202bf1840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1787395077.272346:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b336273400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b202bf1e40 00000020:00080000:2.0:1787395077.272349:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b336273f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b33f428800 00000020:00080000:3.0:1787395077.272724:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787395077.272992:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787395077.273119:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323429376:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787395077.273192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395077.273330:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323429376 00000100:00100000:0.0:1787395077.273338:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323429376 00000100:00100000:0.0:1787395077.273400:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787395077.273410:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323429376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787395077.273434:0:8490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787395077.273468:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a897c04, atime: 0x6a897c04, ctime: 0x6a897c04, blocks: 0x1 00010000:00010000:0.0:1787395077.273477:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.273493:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1787395077.273497:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395077.273504:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.273520:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.273531:0:8490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.273540:0:8490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.273575:0:8490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787395077.274207:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323429376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 797us (1013us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787395077.274216:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787395077.274295:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787395077.274361:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b33ff3aa00/2, rc 0, transno 4294967307 00000100:00100000:2.0:1787395077.274368:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323429376:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787395077.274596:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395077.274603:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.274613:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395077.274618:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.274628:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.274645:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.274653:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d669cc73/0xedbabbe2e89a8a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.274675:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395077.274677:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395077.274679:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395077.504476:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395077.506943:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304555648 00000100:00100000:0.0:1787395077.506957:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304555648 00000100:00100000:0.0:1787395077.507053:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 156 00000100:00100000:0.0:1787395077.507064:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+17:11416:x1874219304555648:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:0.0:1787395077.507088:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395077.507109:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2414 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507176:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507190:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507203:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507221:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507229:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507236:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507667:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507680:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507690:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507733:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.507748:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 18 pid: 5802 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395077.507762:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff38700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323429504:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395077.507859:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f9149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395077.512655:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff38700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323429504:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395077.512698:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395077.515029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395077.515375:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304555904 00000100:00100000:3.0:1787395077.515393:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304555904 00000100:00100000:3.0:1787395077.515492:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:3.0:1787395077.515504:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:5577:x1874219304555904:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787395077.521598:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+20:5577:x1874219304555904:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 3039us (3538us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787395077.521620:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:2.0:1787395077.525495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.525961:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304556032 00000100:00100000:1.0:1787395077.526127:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304556032 00010000:00010000:1.0:1787395077.526206:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 20 pid: 5802 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395077.526347:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:1.0:1787395077.526367:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+20:2364:x1874219304556032:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395077.526391:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395077.526403:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 20 pid: 5802 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526424:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 20 pid: 5802 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526462:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc240d expref: 20 pid: 5802 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526489:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395077.526495:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526505:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526513:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.526592:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395077.526686:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+19:2364:x1874219304556032:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 326us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395077.526697:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00010000:00010000:0.0:1787395077.527755:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.527773:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395077.527870:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787395077.527879:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395077.527926:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.527950:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.527967:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528001:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528011:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528031:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395077.528038:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528049:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528073:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395077.528078:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395077.528084:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528093:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528118:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528127:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528134:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528141:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395077.528160:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528171:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528184:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318946000) 00010000:00010000:0.0:1787395077.528188:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395077.528192:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528201:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528260:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8a47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2414 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528276:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2414 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395077.528285:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395077.528288:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395077.528292:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011c00, rc 0) 00000100:00100000:0.0:1787395077.528464:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b337fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+18:11416:x1874219304555648:12345-192.168.203.16@tcp:101:stat.0 Request processed in 21398us (24002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395077.528479:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 156 00010000:00010000:3.0:1787395077.586846:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395077.610659:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.610879:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304556288 00000100:00100000:1.0:1787395077.610896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304556288 00000100:00100000:1.0:1787395077.610969:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 157 00000100:00100000:1.0:1787395077.610979:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+18:11422:x1874219304556288:12345-192.168.203.16@tcp:36:truncate.0 00010000:00010000:1.0:1787395077.611187:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395077.611222:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2414 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.611246:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395077.611251:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395077.611662:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.611679:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.611691:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395077.611755:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787395077.611782:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de3c146d reply state 000000006c016cdd transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395077.611794:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395077.612279:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+20:11422:x1874219304556288:12345-192.168.203.16@tcp:36:truncate.0 Request processed in 1296us (1631us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787395077.612291:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 157 00000020:00080000:1.0:1787395077.612299:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395077.619193:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619217:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619227:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619234:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395077.619240:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619274:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619299:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395077.619345:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395077.619355:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.619363:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8a63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395077.872387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395077.873589:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304556416 00000100:00100000:1.0:1787395077.873604:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304556416 00000100:00100000:1.0:1787395077.873674:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 158 00000100:00100000:1.0:1787395077.873686:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+19:11436:x1874219304556416:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:1.0:1787395077.873711:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395077.873732:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc241b expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873810:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873825:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873838:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873854:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873861:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.873869:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874204:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874219:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874226:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395077.874264:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787395077.874268:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395077.874286:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874297:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874339:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874347:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874353:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874359:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395077.874362:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874369:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874380:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395077.874388:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395077.874394:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874400:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129000/0xedbabbe2e89a8a71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874414:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874419:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874428:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874432:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395077.874435:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874456:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874465:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318517700) 00010000:00010000:1.0:1787395077.874467:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395077.874469:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874474:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874506:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874532:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 20 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395077.874539:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395077.874541:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395077.874543:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128e00, rc 0) 00000100:00100000:1.0:1787395077.874612:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+20:11436:x1874219304556416:12345-192.168.203.16@tcp:101:stat.0 Request processed in 928us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395077.874620:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 158 00000100:00100000:0.0:1787395077.967071:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395077.967186:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304556672 00000100:00100000:3.0:1787395077.967199:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304556672 00000100:00100000:3.0:1787395077.967277:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 159 00000100:00100000:3.0:1787395077.967288:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+20:11446:x1874219304556672:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395077.968508:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395077.968543:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2422 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395077.968830:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787395077.969159:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8a86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2422 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.969175:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:2.0:1787395077.969178:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395077.969184:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2422 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395077.969197:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395077.969271:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+21:11446:x1874219304556672:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1984us (2215us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787395077.969291:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 159 00000100:00100000:3.0:1787395077.980255:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395077.980383:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304556928 00000100:00100000:2.0:1787395077.980399:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304556928 00000100:00100000:2.0:1787395077.980471:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:2.0:1787395077.980483:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+21:11446:x1874219304556928:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395077.980978:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+22:11446:x1874219304556928:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 496us (744us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787395077.980987:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:0.0:1787395078.021107:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.021244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.021288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.021387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.021426:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557440 00000100:00100000:0.0:1787395078.021439:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557440 00000100:00080000:0.0:1787395078.021473:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395078.021530:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:0.0:1787395078.021541:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304557440:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395078.021834:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557312 00000100:00100000:2.0:1787395078.021840:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557312 00000100:00100000:2.0:1787395078.021880:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557184 00000100:00100000:2.0:1787395078.021883:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557184 00000100:00100000:2.0:1787395078.021906:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1787395078.021914:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304557312:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395078.021979:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304557312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 66us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395078.021987:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1787395078.022008:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:2.0:1787395078.022026:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304557184:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395078.022051:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2364:x1874219304557184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395078.022058:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00080000:2.0:1787395078.022073:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787395078.022076:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787395078.022556:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557056 00000100:00100000:3.0:1787395078.022567:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557056 00000100:00100000:3.0:1787395078.022625:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 289 00000100:00100000:3.0:1787395078.022641:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304557056:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395078.022653:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b202ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2364:x1874219304557440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1110us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395078.022665:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 138 00000100:00100000:3.0:1787395078.022687:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304557056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 50us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395078.022714:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 289 00000100:00100000:0.0:1787395078.092490:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395078.092893:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557696 00000100:00100000:1.0:1787395078.092909:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557696 00000100:00100000:1.0:1787395078.092993:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 160 00000100:00100000:1.0:1787395078.093007:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+22:11452:x1874219304557696:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395078.093052:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395078.093082:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2429 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.093227:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.093245:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 23 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.093255:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.093297:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 23 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.093366:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 23 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395078.093384:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323429632:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395078.093521:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395078.097706:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323429632:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395078.097746:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395078.101179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395078.101363:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304557824 00000100:00100000:1.0:1787395078.101378:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304557824 00010000:00010000:1.0:1787395078.101440:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 24 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395078.101496:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:1.0:1787395078.101508:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+24:2363:x1874219304557824:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395078.101526:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395078.101534:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 24 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101551:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 24 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101584:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8a7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc241b expref: 24 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101630:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395078.101636:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101649:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101658:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.101709:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395078.101766:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.101785:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395078.101798:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+23:2363:x1874219304557824:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 277us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395078.101808:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 68 00000004:00200000:2.0:1787395078.101813:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787395078.102049:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 24 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.102070:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 23 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.102077:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395078.102080:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395078.102082:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129c00, rc 0) 00000100:00100000:2.0:1787395078.102114:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+23:11452:x1874219304557696:12345-192.168.203.16@tcp:101:bash.0 Request processed in 9112us (9640us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787395078.102122:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 160 00000100:00100000:0.0:1787395078.112387:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.112474:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558080 00000100:00100000:2.0:1787395078.112488:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558080 00000100:00100000:2.0:1787395078.112616:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 161 00000100:00100000:2.0:1787395078.112629:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+23:11452:x1874219304558080:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:2.0:1787395078.113096:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.113119:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.113134:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787395078.113212:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787395078.113240:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018e6d18f reply state 00000000d565483b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395078.113247:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395078.113391:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+26:11452:x1874219304558080:12345-192.168.203.16@tcp:36:bash.0 Request processed in 763us (1018us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787395078.113400:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 161 00000020:00080000:2.0:1787395078.113406:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395078.116209:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116689:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116699:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116705:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.116711:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116720:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116741:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395078.116745:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.116751:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.116757:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8aa9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395078.127803:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.127917:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558208 00000100:00100000:2.0:1787395078.127932:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558208 00000100:00100000:2.0:1787395078.128238:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 162 00000100:00100000:2.0:1787395078.128252:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:11452:x1874219304558208:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395078.128296:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395078.128450:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ab0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2430 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.128587:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.128606:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 26 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.128616:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.128657:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 26 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.128672:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 26 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395078.128690:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323429760:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395078.129184:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787395078.142222:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323429760:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395078.142235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395078.142268:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395078.142370:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558336 00000100:00100000:1.0:1787395078.142380:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558336 00010000:00010000:1.0:1787395078.142428:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 27 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395078.142484:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:1.0:1787395078.142494:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+27:2364:x1874219304558336:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395078.142512:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395078.142519:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 27 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142533:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 27 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142576:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2429 expref: 27 pid: 11555 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142595:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395078.142601:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142612:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142621:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.142652:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395078.142731:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f526d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:2364:x1874219304558336:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 236us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395078.142739:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00010000:00010000:0.0:1787395078.142831:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.142839:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395078.142900:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787395078.142906:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395078.142932:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.142971:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ab0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2430 expref: 26 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.142987:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2430 expref: 25 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.143003:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395078.143006:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395078.143009:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:0.0:1787395078.143068:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:11452:x1874219304558208:12345-192.168.203.16@tcp:101:bash.0 Request processed in 14817us (15276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395078.143075:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 162 00000100:00100000:0.0:1787395078.160461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.160617:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558592 00000100:00100000:3.0:1787395078.160631:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558592 00000100:00100000:3.0:1787395078.160709:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:3.0:1787395078.160721:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+25:11452:x1874219304558592:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:3.0:1787395078.161066:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+26:11452:x1874219304558592:12345-192.168.203.16@tcp:35:bash.0 Request processed in 345us (632us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787395078.161076:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:1.0:1787395078.274292:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.274392:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558848 00000100:00100000:2.0:1787395078.274407:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558848 00000100:00100000:2.0:1787395078.274507:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 163 00000100:00100000:2.0:1787395078.274519:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+26:11462:x1874219304558848:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395078.274562:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395078.274590:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2437 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395078.274972:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787395078.275201:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8abe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2437 expref: 28 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.275220:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:2.0:1787395078.275223:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395078.275229:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2437 expref: 28 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.275247:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395078.275398:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+27:11462:x1874219304558848:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 881us (1124us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787395078.275408:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 163 00000100:00100000:1.0:1787395078.280086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.284582:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304558976 00000100:00100000:2.0:1787395078.284607:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304558976 00000100:00100000:2.0:1787395078.284713:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:2.0:1787395078.284726:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:11462:x1874219304558976:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:2.0:1787395078.284829:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.284869:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.284884:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.284902:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.284909:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.284916:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285439:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285452:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285462:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395078.285519:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285535:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285542:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285561:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285568:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.285573:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285581:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285596:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395078.285599:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.285604:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285610:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8acc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285625:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285631:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285636:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285642:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.285645:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285661:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285670:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395078.285673:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.285675:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285681:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285701:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285708:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285714:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285720:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.285723:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285728:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285734:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395078.285737:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.285740:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.285755:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395078.285864:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:11462:x1874219304558976:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1137us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395078.285875:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:1.0:1787395078.292479:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.293358:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304559232 00000100:00100000:3.0:1787395078.293377:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304559232 00000100:00100000:3.0:1787395078.293477:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:3.0:1787395078.293492:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+27:11462:x1874219304559232:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395078.298756:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+28:11462:x1874219304559232:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 5243us (6271us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787395078.298776:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:1.0:1787395078.405445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.405548:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304559488 00000100:00100000:0.0:1787395078.405562:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304559488 00000100:00100000:0.0:1787395078.405643:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:0.0:1787395078.405656:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+28:11465:x1874219304559488:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395078.405693:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395078.405725:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc243e expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405840:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405859:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405873:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405890:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405897:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.405924:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406579:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406591:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406600:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395078.406612:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787395078.406737:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406745:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406752:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406758:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395078.406762:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.406770:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407090:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395078.407095:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395078.407112:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407118:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407136:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407142:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407148:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407153:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395078.407156:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407161:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407169:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318946500) 00010000:00010000:0.0:1787395078.407171:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395078.407174:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407179:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407403:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc243e expref: 31 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407434:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc243e expref: 30 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.407441:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:0.0:1787395078.407443:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395078.407446:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395078.407546:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+30:11465:x1874219304559488:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1892us (2114us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787395078.407556:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:2.0:1787395078.413099:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.413154:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395078.413337:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304559616 00000100:00100000:1.0:1787395078.413351:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304559616 00000100:00100000:1.0:1787395078.413431:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:1.0:1787395078.413443:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+30:2363:x1874219304559616:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395078.413464:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395078.413497:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc243e expref: 30 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.413540:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395078.413547:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395078.413626:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+29:2363:x1874219304559616:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 185us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395078.413635:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1787395078.414105:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304559744 00000100:00100000:3.0:1787395078.414112:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304559744 00000100:00100000:3.0:1787395078.414161:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:3.0:1787395078.414169:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:11465:x1874219304559744:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:3.0:1787395078.414261:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414278:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414290:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414368:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414376:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414383:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414391:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395078.414396:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414404:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414414:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395078.414417:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787395078.414422:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.414427:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395078.414907:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:11465:x1874219304559744:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 736us (1749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395078.414915:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:2.0:1787395078.423430:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.423612:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304560000 00000100:00100000:3.0:1787395078.423626:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304560000 00000100:00100000:3.0:1787395078.423701:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:3.0:1787395078.423730:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:11465:x1874219304560000:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395078.424103:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+30:11465:x1874219304560000:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 373us (687us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787395078.424117:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00010000:00010000:3.0:1787395078.610656:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395078.626772:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.626958:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304560256 00000100:00100000:3.0:1787395078.626972:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304560256 00000100:00100000:3.0:1787395078.627058:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:3.0:1787395078.627071:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+30:11483:x1874219304560256:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:3.0:1787395078.627106:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395078.627135:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2445 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.627281:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b12 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.627300:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.627357:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b12 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395078.627372:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787395078.627544:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2445 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.627569:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b12 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2445 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.627601:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395078.627604:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787395078.627609:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395078.627703:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+32:11483:x1874219304560256:12345-192.168.203.16@tcp:101:cat.0 Request processed in 634us (947us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1787395078.627711:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:2.0:1787395078.663899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395078.667341:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304560384 00000100:00100000:0.0:1787395078.667366:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304560384 00000100:00100000:0.0:1787395078.667564:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:0.0:1787395078.667579:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+32:11484:x1874219304560384:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395078.667616:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395078.667652:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc244c expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.667761:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.667778:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.667794:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395078.668295:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787395078.668341:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395078.668432:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.669019:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc244c expref: 34 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.669047:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc244c expref: 33 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395078.669058:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395078.669062:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787395078.669066:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010000, rc 0) 00000100:00100000:0.0:1787395078.669191:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+33:11484:x1874219304560384:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1614us (5306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395078.669201:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:1.0:1787395078.674483:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.675036:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304560768 00000100:00100000:3.0:1787395078.675050:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304560768 00000100:00100000:3.0:1787395078.675147:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:3.0:1787395078.675160:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:11484:x1874219304560768:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1787395078.675681:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:11484:x1874219304560768:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 520us (1210us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787395078.675691:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:2.0:1787395078.680082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395078.680294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304560896 00000100:00100000:1.0:1787395078.680415:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304560896 00000100:00100000:1.0:1787395078.680711:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:1.0:1787395078.680725:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:11484:x1874219304560896:12345-192.168.203.16@tcp:103:lfs.0 00010000:00010000:1.0:1787395078.680745:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787395078.680777:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8ab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2430 expref: 34 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.680814:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2445 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.680829:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a89bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23f1 expref: 32 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395078.680841:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395078.680864:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395078.680951:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+31:11484:x1874219304560896:12345-192.168.203.16@tcp:103:lfs.0 Request processed in 229us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395078.680968:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395078.685650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395078.685795:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561024 00000100:00100000:3.0:1787395078.685810:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561024 00000100:00100000:3.0:1787395078.685909:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 169 00000100:00100000:3.0:1787395078.685921:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+31:11484:x1874219304561024:12345-192.168.203.16@tcp:58:lfs.0 00010000:00010000:3.0:1787395078.686128:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.686149:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395078.686163:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787395078.686658:0:11555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787395078.686782:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+31:11484:x1874219304561024:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 860us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395078.686793:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 169 00000100:00100000:3.0:1787395078.745574:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395078.745815:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561152 00000100:00100000:2.0:1787395078.745828:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561152 00000100:00100000:2.0:1787395078.745908:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 170 00000100:00100000:2.0:1787395078.745920:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+31:11486:x1874219304561152:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395078.745949:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395078.746203:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2453 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746506:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746523:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746538:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746573:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746581:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.746588:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747399:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747415:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747486:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395078.747536:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787395078.747541:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395078.747566:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747579:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747589:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747596:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747616:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747624:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.747629:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747638:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747654:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395078.747658:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.747663:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747670:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747686:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747693:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747700:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747705:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395078.747709:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747725:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747734:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395078.747736:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395078.747739:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.747746:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.748674:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 33 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.748706:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 32 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395078.748716:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395078.748719:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395078.748722:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49200, rc 0) 00000100:00100000:2.0:1787395078.748837:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+32:11486:x1874219304561152:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2918us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395078.748856:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 170 00000040:00080000:0.0:1787395079.186492:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395079.186501:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395079.186543:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1787395079.186551:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395079.186675:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f524e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323429888:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395079.186769:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787395079.188555:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f524e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323429888:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395079.199456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.199516:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561280 00000100:00100000:0.0:1787395079.199526:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561280 00000100:00100000:0.0:1787395079.199593:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 171 00000100:00100000:0.0:1787395079.199603:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+32:11497:x1874219304561280:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787395079.199645:0:6624:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787395079.199766:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+32:11497:x1874219304561280:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 164us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395079.199775:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 171 00000100:00080000:2.0:1787395079.200045:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395079.206454:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395079.206968:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561408 00000100:00100000:2.0:1787395079.206978:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561408 00000100:00100000:2.0:1787395079.207053:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 172 00000100:00100000:2.0:1787395079.207064:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:11497:x1874219304561408:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787395079.207151:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207168:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207182:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207195:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207202:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207208:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207530:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207539:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207546:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395079.207583:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787395079.207587:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395079.207599:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207610:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207624:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207630:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207636:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395079.207641:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207647:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207659:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:2.0:1787395079.207662:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395079.207666:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207671:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8b51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207683:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207688:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207694:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207699:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395079.207706:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207712:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207719:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395079.207721:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395079.207724:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207730:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8b58 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207746:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207752:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207758:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207763:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395079.207765:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207771:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207776:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395079.207778:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395079.207785:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.207791:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395079.209425:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:11497:x1874219304561408:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 2353us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395079.209438:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 172 00000100:00100000:2.0:1787395079.232481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.234437:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561664 00000100:00100000:3.0:1787395079.234450:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561664 00000100:00100000:3.0:1787395079.234516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 173 00000100:00100000:3.0:1787395079.234526:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+32:11497:x1874219304561664:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.234545:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395079.234565:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b66 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc245a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234661:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234676:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234687:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395079.234698:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787395079.234785:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234792:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234809:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234815:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55dc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.234820:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.234827:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.235018:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395079.235022:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395079.235027:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.235034:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.235072:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b66 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc245a expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.235081:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:3.0:1787395079.235084:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787395079.235087:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b66 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc245a expref: 34 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.235096:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395079.235160:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304561664:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 636us (2691us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787395079.235177:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 173 00000100:00100000:3.0:1787395079.241257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395079.241365:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304561792 00000100:00100000:2.0:1787395079.241376:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304561792 00000100:00100000:2.0:1787395079.241447:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:2.0:1787395079.241458:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304561792:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787395079.241498:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787395079.241619:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304561792:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 162us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395079.241627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:2.0:1787395079.245808:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.245899:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562048 00000100:00100000:3.0:1787395079.245909:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562048 00000100:00100000:3.0:1787395079.245976:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 175 00000100:00100000:3.0:1787395079.245985:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304562048:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.246014:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395079.246017:0:11555:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787395079.246044:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8b27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc244c expref: 33 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.246066:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395079.246071:0:11555:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395079.246086:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8b7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2461 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395079.246813:0:11555:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787395079.247051:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8b82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.247065:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.247074:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8b82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.247126:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2461 expref: 35 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.247153:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8b82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2461 expref: 34 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.247160:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395079.247163:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395079.247166:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787395079.247225:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+34:11497:x1874219304562048:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1242us (1426us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787395079.247233:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 175 00000100:00100000:1.0:1787395079.260426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.261179:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562304 00000100:00100000:3.0:1787395079.261191:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562304 00000100:00100000:3.0:1787395079.261261:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:3.0:1787395079.261272:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+34:11497:x1874219304562304:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.261360:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395079.261387:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8b82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2461 expref: 34 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261405:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395079.261428:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395079.261450:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261465:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261476:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261504:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261511:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261518:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261792:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261800:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261807:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261812:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.261816:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261824:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261832:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395079.261835:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395079.261839:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261844:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8b90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261859:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261866:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261871:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261877:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.261880:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261886:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261893:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x530e888b (ffffa0b308bf3200) 00010000:00010000:3.0:1787395079.261896:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395079.261899:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.261904:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x530e888b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.262190:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304562304:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 917us (1780us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787395079.262198:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:3.0:1787395079.264936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.265097:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562432 00000100:00100000:1.0:1787395079.265107:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562432 00000100:00100000:1.0:1787395079.265167:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 177 00000100:00100000:1.0:1787395079.265177:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:11497:x1874219304562432:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395079.265196:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395079.265234:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8b9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2468 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265269:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265281:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265293:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265412:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8b9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265431:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.265440:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395079.265443:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787395079.265447:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128000, rc 0) 00000100:00100000:1.0:1787395079.265512:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+34:11497:x1874219304562432:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 337us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.265529:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 177 00000100:00100000:1.0:1787395079.268201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.268355:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562688 00000100:00100000:0.0:1787395079.268368:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562688 00000100:00100000:0.0:1787395079.268458:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 178 00000100:00100000:0.0:1787395079.268472:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+34:11497:x1874219304562688:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787395079.268592:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.268618:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.268637:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787395079.269550:0:6624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787395079.269702:0:6624:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351218394571ns, next at 352218252328ns, rc = 0 00000004:00010000:0.0:1787395079.269860:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cabf0da3 reply state 00000000c56d2274 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395079.269871:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395079.270772:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+36:11497:x1874219304562688:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 2295us (2575us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787395079.270781:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 178 00000100:00100000:0.0:1787395079.276682:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.277283:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562816 00000100:00100000:3.0:1787395079.277292:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562816 00000100:00100000:3.0:1787395079.277379:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 179 00000100:00100000:3.0:1787395079.277387:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+36:11497:x1874219304562816:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.277409:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395079.277426:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc246f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.277476:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.277489:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.277506:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395079.277509:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395079.277513:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d600, rc 0) 00000100:00100000:3.0:1787395079.277562:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+37:11497:x1874219304562816:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 176us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.277569:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 179 00010000:00010000:1.0:1787395079.279504:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279520:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279528:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279533:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395079.279537:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279544:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279560:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395079.279563:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787395079.279567:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.279573:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8bac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.285499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395079.285569:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304562944 00000100:00100000:2.0:1787395079.285579:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304562944 00000100:00100000:2.0:1787395079.285637:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395079.285647:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+6:2366:x1874219304562944:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787395079.285965:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3367bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304562944:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 307us (464us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787395079.285974:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395079.300547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.300622:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304563200 00000100:00100000:0.0:1787395079.300637:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304563200 00000100:00100000:0.0:1787395079.300688:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:0.0:1787395079.300698:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:11497:x1874219304563200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787395079.300921:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+37:11497:x1874219304563200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 224us (379us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787395079.300930:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:0.0:1787395079.308573:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.308734:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304563456 00000100:00100000:3.0:1787395079.308744:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304563456 00000100:00100000:3.0:1787395079.308800:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 180 00000100:00100000:3.0:1787395079.308811:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+37:11497:x1874219304563456:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787395079.308950:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+37:11497:x1874219304563456:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 141us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.308966:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 180 00000100:00100000:0.0:1787395079.324861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.324932:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304563584 00000100:00100000:3.0:1787395079.324949:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304563584 00000100:00100000:3.0:1787395079.325035:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 181 00000100:00100000:3.0:1787395079.325046:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+37:11497:x1874219304563584:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.325069:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395079.325087:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2476 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325161:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325176:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325189:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395079.325434:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395079.325454:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325482:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2476 expref: 39 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325498:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2476 expref: 38 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.325868:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395079.325873:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395079.325877:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395079.325940:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+38:11497:x1874219304563584:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 895us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.326927:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 181 00000100:00100000:2.0:1787395079.334053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.335096:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304563712 00000100:00100000:3.0:1787395079.335107:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304563712 00000100:00100000:3.0:1787395079.335405:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:3.0:1787395079.335416:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304563712:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.335432:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395079.335451:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc247d expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787395079.335474:0:6599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897c07, blocks: 0x1 00010000:00010000:3.0:1787395079.335491:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1787395079.335496:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395079.335503:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.335531:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 8 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.335544:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c000, rc 0) 00000100:00100000:3.0:1787395079.335722:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2366:x1874219304563712:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 307us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.335730:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:0.0:1787395079.347446:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.347564:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304563968 00000100:00100000:1.0:1787395079.347574:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304563968 00000100:00100000:1.0:1787395079.347633:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 182 00000100:00100000:1.0:1787395079.347644:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+38:11497:x1874219304563968:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787395079.347761:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+38:11497:x1874219304563968:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 118us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.347769:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 182 00000100:00100000:0.0:1787395079.352663:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.353721:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564096 00000100:00100000:0.0:1787395079.353733:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564096 00000100:00100000:0.0:1787395079.353790:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:0.0:1787395079.353800:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:11497:x1874219304564096:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395079.353819:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395079.353837:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2484 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.353868:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.353878:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395079.353882:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787395079.353887:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.353921:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.353950:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395079.353979:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323430016:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395079.354074:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787395079.368334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.368384:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f526300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323430016:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395079.368416:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.368438:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011400, rc 0) 00000100:00100000:0.0:1787395079.368486:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f524380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:11497:x1874219304564096:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 14687us (15833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395079.368494:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:1.0:1787395079.369127:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564224 00000100:00100000:1.0:1787395079.369134:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564224 00010000:00010000:1.0:1787395079.369167:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.369201:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:1.0:1787395079.369218:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304564224:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395079.369235:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395079.369258:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.369271:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.369293:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069a54d50/0xedbabbe2e89a8bc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc247d expref: 9 pid: 6599 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.369332:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395079.369336:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395079.369343:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.369370:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.369405:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.369419:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1874219323430144:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395079.369476:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395079.379081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.379135:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fae3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1874219323430144:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787395079.379159:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395079.379206:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302db2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304564224:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 9995us (10879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.379227:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:0.0:1787395079.379419:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564352 00000100:00100000:0.0:1787395079.379426:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564352 00002000:00100000:0.0:1787395079.379465:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0b33633ea00 x1874219304564352/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:540/0 lens 504/0 e 0 to 0 dl 1787395090 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395079.379475:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33633ea00 with x1874219304564352 ext(0->8) 00002000:00010000:0.0:1787395079.379480:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33633ea00 00000100:00100000:0.0:1787395079.379498:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1787395079.379507:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304564352:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787395079.385165:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+10:2363:x1874219304564352:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 Request processed in 5646us (6082us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787395079.385183:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00002000:00100000:0.0:1787395079.385195:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa0b33633ea00 x1874219304564352/t4294967314(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:540/0 lens 504/448 e 0 to 0 dl 1787395090 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395079.385205:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33633ea00 with x1874219304564352 ext(0->8) 00002000:00010000:0.0:1787395079.385275:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33633ea00 00000100:00100000:0.0:1787395079.389410:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.389964:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564480 00000100:00100000:3.0:1787395079.389976:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564480 00000100:00100000:3.0:1787395079.390047:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 183 00000100:00100000:3.0:1787395079.390058:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+38:11497:x1874219304564480:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787395079.458424:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+38:11497:x1874219304564480:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 68359us (69015us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.458436:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 183 00000001:00080000:2.0:1787395079.459628:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1787395079.459642:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787395079.459701:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787395079.461061:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787395079.461076:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787395079.462183:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323430272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787395079.462259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395079.462438:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323430272 00000100:00100000:0.0:1787395079.462445:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323430272 00000100:00100000:0.0:1787395079.462500:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787395079.462508:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323430272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787395079.462660:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787395079.462663:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787395079 00002000:00010000:0.0:1787395079.462666:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787395079.462669:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787395079 -> 1787395079 00002000:00010000:0.0:1787395079.462671:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787395079.462711:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323430272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 203us (451us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787395079.462719:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787395079.462796:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b33f525c00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787395079.462802:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323430272:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1787395079.463030:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395079.468826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.468868:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564608 00000100:00100000:0.0:1787395079.468876:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564608 00000100:00100000:0.0:1787395079.468923:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:0.0:1787395079.468934:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+10:2365:x1874219304564608:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787395079.506750:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:2.0:1787395079.506765:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1787395079.506962:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2365:x1874219304564608:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 38016us (38129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395079.506990:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787395079.517457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.517690:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564864 00000100:00100000:3.0:1787395079.517701:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564864 00000100:00100000:3.0:1787395079.517794:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 184 00000100:00100000:3.0:1787395079.517805:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+19:11497:x1874219304564864:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.517869:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395079.517898:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2476 expref: 19 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.517919:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395079.517925:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395079.517955:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.517978:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.517988:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395079.518398:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000854a0430 reply state 00000000a0223526 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.518408:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787395079.518495:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33633f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+20:11497:x1874219304564864:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 692us (1046us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787395079.518503:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 184 00000100:00100000:0.0:1787395079.520933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.521189:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304564992 00000100:00100000:1.0:1787395079.521198:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304564992 00000100:00100000:1.0:1787395079.521260:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:1.0:1787395079.521270:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304564992:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787395079.521520:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787395079.521524:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787395079 -> 1787395078 00002000:00010000:1.0:1787395079.521527:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787395076 00002000:00010000:1.0:1787395079.521529:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787395079 -> 1787395078 00002000:00010000:1.0:1787395079.521531:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787395079.521600:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304564992:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 330us (674us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787395079.521608:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:0.0:1787395079.525641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.526368:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304565248 00000100:00100000:3.0:1787395079.526379:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304565248 00000100:00100000:3.0:1787395079.526433:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 185 00000100:00100000:3.0:1787395079.526451:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+20:11497:x1874219304565248:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787395079.526518:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.526535:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.526544:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.526578:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 20 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.526593:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 20 pid: 5802 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.526607:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f46df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323430400:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395079.526697:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3081fcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395079.529429:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f46df80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323430400:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395079.529459:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.532117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.532451:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304565376 00000100:00100000:3.0:1787395079.532461:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304565376 00010000:00010000:3.0:1787395079.532501:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 21 pid: 5802 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.532530:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:3.0:1787395079.532539:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+21:2364:x1874219304565376:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395079.532552:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395079.532559:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 21 pid: 5802 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532581:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 21 pid: 5802 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532605:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2468 expref: 21 pid: 5802 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532623:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395079.532628:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532637:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532645:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.532667:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395079.532722:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+20:2364:x1874219304565376:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 183us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.532729:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00010000:00010000:1.0:1787395079.532855:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532863:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532893:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532900:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532914:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532920:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395079.532924:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532932:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532942:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395079.532945:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787395079.532949:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.532965:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.533013:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+19:11497:x1874219304565248:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 Request processed in 6565us (7380us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787395079.533021:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 185 00010000:00010000:2.0:1787395079.535713:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535730:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535737:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535743:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395079.535748:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535754:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535769:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:2.0:1787395079.535772:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395079.535776:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.535782:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8bd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.539430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.542301:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304565504 00000100:00100000:1.0:1787395079.542335:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304565504 00000100:00100000:1.0:1787395079.542394:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:1.0:1787395079.542404:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304565504:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787395079.542451:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.542471:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.542490:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395079.542494:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395079.542499:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.542536:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.542550:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 8 pid: 6601 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.542566:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323430528:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395079.542815:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1840 going to sleep for 11 seconds 00000100:00100000:2.0:1787395079.552513:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323430528:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395079.552557:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.556617:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.556708:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304565632 00000100:00100000:1.0:1787395079.556719:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304565632 00010000:00010000:1.0:1787395079.556760:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.556804:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:1.0:1787395079.556814:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304565632:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395079.556829:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395079.556858:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.556894:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.556919:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d669cc73/0xedbabbe2e89a8bcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2484 expref: 9 pid: 6601 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.556936:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395079.556941:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395079.556946:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.556967:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.557011:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395079.557067:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304565632:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 254us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.557076:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00010000:00010000:3.0:1787395079.557617:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557630:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557673:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557681:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557689:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557696:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395079.557700:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557708:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557723:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.557731:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8be4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.557792:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304565504:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 15389us (18371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395079.557801:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:1.0:1787395079.565444:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395079.566461:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304565888 00000100:00100000:2.0:1787395079.566473:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304565888 00000100:00100000:2.0:1787395079.566535:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 186 00000100:00100000:2.0:1787395079.566544:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+18:11497:x1874219304565888:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787395079.566621:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566637:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566650:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566864:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566875:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566883:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566917:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.566931:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 19 pid: 5804 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395079.566959:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323430656:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395079.567046:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b307a9f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787395079.573491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.573521:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304566016 00000100:00100000:0.0:1787395079.573528:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304566016 00010000:00010000:0.0:1787395079.573560:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 20 pid: 5804 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395079.573667:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323430656:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395079.573691:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.579339:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:1.0:1787395079.579361:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+20:2363:x1874219304566016:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395079.579379:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395079.579390:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 20 pid: 5804 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579421:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 20 pid: 5804 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579446:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc246f expref: 20 pid: 5804 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579462:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:1.0:1787395079.579467:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579475:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579483:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.579513:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395079.579570:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:2363:x1874219304566016:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 219us (6089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.579590:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00010000:00010000:3.0:1787395079.580636:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.580650:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787395079.580839:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787395079.581133:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787395079.581180:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787395079.581365:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f46f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323430784:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787395079.581423:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395079.581458:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395079.581823:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323430784 00000100:00100000:1.0:1787395079.581831:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323430784 00000100:00100000:1.0:1787395079.581893:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787395079.581902:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5803:x1874219323430784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787395079.582104:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5803:x1874219323430784:12345-0@lo:1000:mdt00_001.0 Request processed in 202us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.582112:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787395079.582516:0:5803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787395079.582522:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b33f525c00, transno 4294967315 00000100:00100000:3.0:1787395079.582534:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f46f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323430784:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787395079.583503:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787395079.583593:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f46f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323430912:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787395079.583643:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395079.583713:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395079.590106:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323430912 00000100:00100000:1.0:1787395079.590121:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323430912 00000100:00100000:1.0:1787395079.590189:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787395079.590200:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5803:x1874219323430912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787395079.591547:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323430912:12345-0@lo:1000:mdt00_001.0 Request processed in 1343us (7896us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787395079.591558:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787395079.592327:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f46f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323430912:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787395079.592381:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592393:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592400:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592406:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.592417:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592425:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592443:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b318517c00) 00010000:00010000:3.0:1787395079.592446:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395079.592450:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592457:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8bf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592490:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592496:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592501:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592506:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.592508:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592514:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592521:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395079.592524:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395079.592533:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592538:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8b2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592578:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592594:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592604:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592641:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.592656:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 22 pid: 5803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.592670:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f46d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323431040:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395079.592752:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395079.608928:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.609450:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304566144 00000100:00100000:1.0:1787395079.609460:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304566144 00010000:00010000:1.0:1787395079.609498:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 23 pid: 5803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395079.609535:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:1.0:1787395079.609544:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+23:2363:x1874219304566144:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395079.609558:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395079.609566:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 23 pid: 5803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.609629:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 23 pid: 5803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.609653:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:1.0:1787395079.609659:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.609669:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.609678:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.609708:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395079.609765:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+23:2363:x1874219304566144:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 221us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395079.609773:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00010000:00010000:3.0:1787395079.610973:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2453 expref: 22 pid: 5803 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.610995:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f46d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323431040:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395079.611027:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611046:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611051:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611064:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611071:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611077:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611082:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.611086:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611093:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611106:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395079.611109:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395079.611113:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611119:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8bf9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611132:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611143:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611149:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611155:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395079.611157:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611163:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611172:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395079.611174:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787395079.611177:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.611182:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8beb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395079.611795:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:11497:x1874219304565888:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 45249us (46357us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787395079.611806:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 186 00000020:00080000:3.0:1787395079.611811:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787395079.612241:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395079.612246:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395079.612749:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787395079.612757:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395079.621173:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395079.622647:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304566400 00000100:00100000:3.0:1787395079.622660:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304566400 00000100:00100000:3.0:1787395079.622710:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:3.0:1787395079.622721:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:11497:x1874219304566400:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787395079.623743:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787395079.623832:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787395079.624674:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624691:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624702:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624711:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624718:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624724:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395079.624744:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787395079.624835:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+23:11497:x1874219304566400:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 2113us (3669us total) trans 4294967468 rc 0/0 00010000:00010000:2.0:1787395079.625342:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395079.625351:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.625360:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395079.625365:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.625375:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.625388:0:7492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa0b308bf3200) 00010000:00010000:2.0:1787395079.625392:0:7492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787395079.625395:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.625401:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395079.625424:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395079.625425:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395079.625427:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395079.626618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 50 00000020:00080000:3.0:1787395079.626627:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787395079.637830:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395079.784169:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787395079.784233:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323431168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395079.784294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395079.784412:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323431168 00000100:00100000:2.0:1787395079.784420:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323431168 00000100:00100000:2.0:1787395079.784471:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787395079.784479:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323431168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395079.784501:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787395079.784543:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323431168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395079.784550:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787395079.784609:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323431168:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787395079.836300:0:12318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395079.836331:0:12318:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395079.836380:0:12318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787395079.836386:0:12318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787395079.937366:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395079.937400:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304566656 00000100:00100000:1.0:1787395079.937407:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304566656 00000100:00100000:1.0:1787395079.937450:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 187 00000100:00100000:1.0:1787395079.937458:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+23:11507:x1874219304566656:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395079.937480:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395079.937496:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc248b expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.937920:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8c0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.937934:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.937957:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395079.937969:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787395079.938155:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc248b expref: 26 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.938168:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc248b expref: 25 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395079.938174:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395079.938177:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787395079.938179:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129200, rc 0) 00000100:00100000:1.0:1787395079.938231:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+25:11507:x1874219304566656:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 774us (881us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787395079.938237:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 187 00000100:00100000:3.0:1787395079.940833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395079.947637:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304566784 00000100:00100000:0.0:1787395079.947652:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304566784 00000100:00100000:0.0:1787395079.947761:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 188 00000100:00100000:0.0:1787395079.947771:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+25:11507:x1874219304566784:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:0.0:1787395079.947854:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.947872:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.947884:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.947898:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.947905:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.947929:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948230:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948239:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948246:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395079.948284:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948296:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948302:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948341:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948347:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395079.948350:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948358:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948369:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395079.948377:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395079.948382:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948389:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948402:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948407:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948413:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948418:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395079.948421:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948427:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948435:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318946500) 00010000:00010000:0.0:1787395079.948437:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395079.948440:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948444:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948458:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948471:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948476:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948481:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395079.948484:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948490:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948498:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b318946f00) 00010000:00010000:0.0:1787395079.948500:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395079.948503:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395079.948508:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395079.948588:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+25:11507:x1874219304566784:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 817us (7761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395079.948597:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 188 00000100:00100000:1.0:1787395080.000104:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.000182:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304567040 00000100:00100000:3.0:1787395080.000199:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304567040 00000100:00100000:3.0:1787395080.000250:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00100000:3.0:1787395080.000258:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+25:11510:x1874219304567040:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395080.000278:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.000296:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8c31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2492 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000391:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000406:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000417:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000431:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000438:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000444:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000733:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000741:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000748:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395080.000762:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787395080.000848:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000856:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000862:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000868:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.000872:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000879:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000892:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395080.000894:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395080.000899:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000905:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000914:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000920:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000936:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000941:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.000943:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000950:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000958:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395080.000960:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395080.000963:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.000968:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.001016:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8c31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 28 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.001029:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.001036:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395080.001038:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395080.001040:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166600, rc 0) 00000100:00100000:3.0:1787395080.001102:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+27:11510:x1874219304567040:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 843us (1004us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787395080.001118:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00100000:3.0:1787395080.005773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.005862:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304567168 00000100:00100000:1.0:1787395080.005873:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304567168 00000100:00100000:1.0:1787395080.005939:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 190 00000100:00100000:1.0:1787395080.005958:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:11510:x1874219304567168:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:1.0:1787395080.006045:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006064:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006079:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006123:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006130:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006137:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006143:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395080.006147:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006155:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006166:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:1.0:1787395080.006169:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395080.006173:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.006179:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.006248:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:11510:x1874219304567168:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 299us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.006256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 190 00000100:00100000:3.0:1787395080.012233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.012556:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304567424 00000100:00100000:2.0:1787395080.012568:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304567424 00000100:00100000:2.0:1787395080.012627:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395080.012637:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+27:11510:x1874219304567424:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395080.012858:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+28:11510:x1874219304567424:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 222us (632us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787395080.012867:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:3.0:1787395080.048709:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.055679:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304567680 00000100:00100000:3.0:1787395080.055694:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304567680 00000100:00100000:3.0:1787395080.055759:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 191 00000100:00100000:3.0:1787395080.055769:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+28:11044:x1874219304567680:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395080.055795:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.055819:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8c5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2499 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.055916:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.055932:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.055940:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.055974:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.055987:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 29 pid: 5803 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.056010:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f430000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323431296:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395080.056114:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395080.058982:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f430000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323431296:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395080.059022:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.063847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.066338:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304567808 00000100:00100000:1.0:1787395080.066354:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304567808 00010000:00010000:1.0:1787395080.066401:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 30 pid: 5803 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.066452:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:1.0:1787395080.066461:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+30:2364:x1874219304567808:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395080.066476:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395080.066483:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 30 pid: 5803 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.066495:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 30 pid: 5803 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.066520:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2492 expref: 30 pid: 5803 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.066535:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:1.0:1787395080.066540:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.066549:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.066556:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.067178:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395080.067238:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:2364:x1874219304567808:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 775us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.067246:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00010000:00010000:2.0:1787395080.071492:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.071508:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.071531:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787395080.071688:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8c5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 30 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.071706:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 29 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.071723:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.071726:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395080.071729:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d600, rc 0) 00000100:00100000:2.0:1787395080.072551:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:11044:x1874219304567680:12345-192.168.203.16@tcp:101:bash.0 Request processed in 16777us (23845us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787395080.072561:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 191 00000100:00100000:2.0:1787395080.075746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.075800:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568064 00000100:00100000:3.0:1787395080.075809:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568064 00000100:00100000:3.0:1787395080.075926:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 192 00000100:00100000:3.0:1787395080.075938:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+29:11044:x1874219304568064:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:3.0:1787395080.076231:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.076248:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.076259:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787395080.076347:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787395080.076377:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aef20665 reply state 000000006ea983e7 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.076386:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787395080.076471:0:6624:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787395080.076588:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+33:11044:x1874219304568064:12345-192.168.203.16@tcp:36:bash.0 Request processed in 653us (851us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787395080.076597:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 192 00000020:00080000:3.0:1787395080.076602:0:6624:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787395080.078974:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.078987:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.078995:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.079013:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.079018:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.079026:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.079042:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.079046:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.079050:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.079057:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8c70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.079869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.079958:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568192 00000100:00100000:3.0:1787395080.079968:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568192 00000100:00100000:3.0:1787395080.080039:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 193 00000100:00100000:3.0:1787395080.080048:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+32:11044:x1874219304568192:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395080.080070:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.080089:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8c77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24a0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.080143:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a0 expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.080157:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8c77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a0 expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.080172:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395080.080175:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395080.080178:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395080.080424:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+33:11044:x1874219304568192:12345-192.168.203.16@tcp:101:bash.0 Request processed in 376us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395080.080433:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 193 00000100:00100000:0.0:1787395080.083697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.083764:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568320 00000100:00100000:1.0:1787395080.083786:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568320 00000100:00100000:1.0:1787395080.084401:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:1.0:1787395080.084411:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:11044:x1874219304568320:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:1.0:1787395080.084430:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395080.084452:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24a7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787395080.084481:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a897c06, atime: 0x6a897c04, ctime: 0x6a897c06, blocks: 0xb 00010000:00010000:1.0:1787395080.084502:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1787395080.084507:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395080.084515:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.084533:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.084546:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129000, rc 0) 00000100:00100000:1.0:1787395080.084621:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:11044:x1874219304568320:12345-192.168.203.16@tcp:101:bash.0 Request processed in 211us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.084628:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00080000:2.0:1787395080.084990:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395080.086468:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.086565:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568448 00000100:00100000:1.0:1787395080.086572:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568448 00002000:00010000:1.0:1787395080.086647:0:6606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787395080.086653:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34107ea00 with x1874219304568448 ext(0->18446744073709551615) 00002000:00010000:1.0:1787395080.086664:0:6606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34107ea00. 00000100:00100000:1.0:1787395080.086692:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:1.0:1787395080.086701:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304568448:12345-192.168.203.16@tcp:10:bash.0 00002000:00010000:1.0:1787395080.086947:0:6606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787395080.087058:0:6606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787395078 -> 1787395080 00002000:00010000:1.0:1787395080.087061:0:6606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787395076 -> 1787395076 00002000:00010000:1.0:1787395080.087063:0:6606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787395078 -> 1787395080 00002000:00010000:1.0:1787395080.087065:0:6606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787395080.087211:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304568448:12345-192.168.203.16@tcp:10:bash.0 Request processed in 511us (749us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787395080.087219:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00002000:00010000:1.0:1787395080.087223:0:6606:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1787395080.087225:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b34107ea00 with x1874219304568448 ext(0->18446744073709551615) 00002000:00010000:1.0:1787395080.087229:0:6606:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b34107ea00. 00000100:00100000:3.0:1787395080.148300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.148439:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568576 00000100:00100000:2.0:1787395080.148450:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568576 00000100:00100000:2.0:1787395080.148508:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 194 00000100:00100000:2.0:1787395080.148519:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+33:11524:x1874219304568576:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:2.0:1787395080.148608:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148625:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148636:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148651:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148657:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148664:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148975:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148984:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.148992:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395080.149052:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149064:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149070:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149077:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149084:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.149093:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149100:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149113:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395080.149115:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.149120:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149127:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149140:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149146:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149159:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149164:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.149167:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149174:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149182:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395080.149184:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.149187:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149194:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8c8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149211:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149217:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149223:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149227:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.149229:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149244:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149251:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.149253:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.149256:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.149262:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.149383:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+33:11524:x1874219304568576:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 864us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.149392:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 194 00000100:00100000:1.0:1787395080.192538:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.192636:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568832 00000100:00100000:3.0:1787395080.192646:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568832 00000100:00100000:3.0:1787395080.192706:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 195 00000100:00100000:3.0:1787395080.192716:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+33:11527:x1874219304568832:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395080.192736:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.192756:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8c9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24ae expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.192844:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.192863:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193081:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193111:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193118:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193124:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193480:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8caf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193490:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193498:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8caf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395080.193507:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787395080.193595:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193603:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193615:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193621:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.193625:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193633:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193645:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395080.193648:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395080.193652:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193658:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d800/0xedbabbe2e89a8ca1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193670:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193676:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193681:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193685:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.193688:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193707:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193715:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b308bf3700) 00010000:00010000:3.0:1787395080.193717:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395080.193720:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193725:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c000/0xedbabbe2e89a8ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193765:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55dc00/0xedbabbe2e89a8c9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ae expref: 36 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193777:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8caf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ae expref: 35 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.193783:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395080.193785:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395080.193787:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c400, rc 0) 00000100:00100000:3.0:1787395080.193842:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fae6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+35:11527:x1874219304568832:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1128us (1312us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787395080.193850:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 195 00000100:00100000:0.0:1787395080.200515:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.200819:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304568960 00000100:00100000:3.0:1787395080.200828:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304568960 00000100:00100000:3.0:1787395080.200906:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 196 00000100:00100000:3.0:1787395080.200917:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+35:11527:x1874219304568960:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:3.0:1787395080.201006:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.201024:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 35 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.201033:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.201064:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 35 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.201077:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 35 pid: 11555 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.201091:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f432680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323431424:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395080.201182:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787395080.204922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.205516:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304569216 00000100:00100000:2.0:1787395080.205527:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304569216 00000100:00100000:2.0:1787395080.205594:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:2.0:1787395080.205605:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:5576:x1874219304569216:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787395080.205919:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+37:5576:x1874219304569216:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 311us (1010us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787395080.205925:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:3.0:1787395080.207144:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f432680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1874219323431424:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395080.207173:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.209174:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.212778:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304569344 00000100:00100000:2.0:1787395080.212792:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304569344 00010000:00010000:2.0:1787395080.212838:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 37 pid: 11555 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.212890:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:2.0:1787395080.212899:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+37:2364:x1874219304569344:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.212929:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395080.212936:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 37 pid: 11555 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.212950:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 37 pid: 11555 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.212972:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d600/0xedbabbe2e89a8c62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2499 expref: 37 pid: 11555 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.212990:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.212994:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.213017:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.213024:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.213055:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395080.213125:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:2364:x1874219304569344:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 226us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.213133:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00010000:00010000:3.0:1787395080.213255:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213263:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213292:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213356:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213363:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213369:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.213373:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213381:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213389:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:3.0:1787395080.213392:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787395080.213396:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.213402:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.213443:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+35:11527:x1874219304568960:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 12528us (12937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395080.213451:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 196 00000100:00100000:1.0:1787395080.218750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.218846:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304569600 00000100:00100000:2.0:1787395080.218856:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304569600 00000100:00100000:2.0:1787395080.218925:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:2.0:1787395080.218935:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+35:11527:x1874219304569600:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395080.219436:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:11527:x1874219304569600:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 499us (691us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787395080.219444:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:0.0:1787395080.275105:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323431808:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.275195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395080.275248:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787395080.275254:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323431936:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.275280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395080.275333:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323431936 00000100:00100000:0.0:1787395080.275341:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323431936 00000100:00100000:0.0:1787395080.275383:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787395080.275392:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323431936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.275443:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874219323431936:12345-0@lo:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.275451:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787395080.275490:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323431936:0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275584:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323431552:0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395080.275654:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323432064:0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395080.275692:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787395080.275696:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323431680:0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395080.275730:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323432192:0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395080.275772:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323432192 00000100:00100000:2.0:1787395080.275776:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323432192 00000100:00100000:2.0:1787395080.275808:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787395080.275816:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395080.275848:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323432192:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.275853:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1787395080.275870:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395080.275888:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323432192:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276076:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323431552 00000100:00100000:0.0:1787395080.276080:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323431552 00000100:00100000:0.0:1787395080.276116:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787395080.276124:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323431552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276163:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3303:x1874219323431552:12345-0@lo:400:kworker.0 Request processed in 39us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.276170:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787395080.276202:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323431552:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276221:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323431808 00000100:00100000:0.0:1787395080.276224:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323431808 00000100:00100000:0.0:1787395080.276250:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323432064 00000100:00100000:0.0:1787395080.276252:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323432064 00000100:00100000:0.0:1787395080.276269:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323431680 00000100:00100000:0.0:1787395080.276272:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323431680 00000100:00100000:0.0:1787395080.276347:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787395080.276352:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323431808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276393:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323431808:12345-0@lo:400:kworker.0 Request processed in 40us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.276398:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787395080.276411:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787395080.276416:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323432064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276440:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323432064:12345-0@lo:400:kworker.0 Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.276444:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787395080.276452:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787395080.276457:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323431680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276476:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323431680:12345-0@lo:400:kworker.0 Request processed in 19us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.276481:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1787395080.276494:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395080.276509:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323431680:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276517:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.276540:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34100ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323431808:0@lo:400:kworker.0 00000100:00100000:0.0:1787395080.317716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.318209:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304569856 00000100:00100000:2.0:1787395080.318219:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304569856 00000100:00100000:2.0:1787395080.318341:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 197 00000100:00100000:2.0:1787395080.318351:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+36:11538:x1874219304569856:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:2.0:1787395080.318388:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.318409:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8cc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24b5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318478:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318493:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318504:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318518:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318526:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.318532:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319118:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319129:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319137:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.319146:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787395080.319247:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319255:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319261:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319267:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.319272:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319279:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319291:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395080.319294:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.319298:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319303:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8ccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319338:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319344:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319350:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319354:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.319362:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319368:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319376:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395080.319378:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.319380:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319386:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319424:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8cc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24b5 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319437:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24b5 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.319444:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.319446:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395080.319448:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395080.319563:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+38:11538:x1874219304569856:12345-192.168.203.16@tcp:101:cat.0 Request processed in 1214us (1856us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787395080.319571:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 197 00000100:00100000:1.0:1787395080.324699:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395080.325023:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304570112 00000100:00100000:0.0:1787395080.325032:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304570112 00000100:00100000:0.0:1787395080.325120:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787395080.325132:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+38:11538:x1874219304570112:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:0.0:1787395080.325391:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+39:11538:x1874219304570112:12345-192.168.203.16@tcp:35:cat.0 Request processed in 261us (700us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787395080.325416:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:1.0:1787395080.341378:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.341452:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304570368 00000100:00100000:2.0:1787395080.341462:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304570368 00000100:00100000:2.0:1787395080.341521:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 198 00000100:00100000:2.0:1787395080.341531:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+39:11539:x1874219304570368:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:2.0:1787395080.341615:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787395080.341642:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24b5 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341664:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c400/0xedbabbe2e89a8caf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ae expref: 38 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341676:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a8c77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a0 expref: 37 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341685:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b308bf3b00) 00010000:00010000:2.0:1787395080.341695:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395080.341715:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341728:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341736:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341751:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341757:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.341764:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.342092:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.342101:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.342108:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787395080.343011:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787395080.343021:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352291713735ns, next at 353291711640ns, rc = 0 00010000:00010000:1.0:1787395080.343082:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343093:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343103:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343122:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343129:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343134:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343161:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395080.343183:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343190:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343195:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343200:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395080.343204:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343211:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343222:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:1.0:1787395080.343224:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787395080.343228:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343243:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8cf5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343260:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343266:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343271:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343275:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395080.343278:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343284:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343291:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395080.343294:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395080.343297:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.343303:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8ce7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787395080.343340:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f4b6a785 reply state 000000007de8e39f transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.343348:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395080.343438:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+38:11539:x1874219304570368:12345-192.168.203.16@tcp:36:rm.0 Request processed in 1905us (2063us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787395080.343447:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 198 00010000:00010000:2.0:1787395080.345537:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395080.345559:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.345569:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128000 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395080.345573:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.345583:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.345599:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa0b3112e7800) 00010000:00010000:2.0:1787395080.345602:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787395080.345605:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.345611:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8cfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.345635:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395080.345636:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395080.345638:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395080.355605:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355622:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355630:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355636:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.355641:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355649:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355670:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7100) 00010000:00010000:2.0:1787395080.355673:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.355678:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.355684:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8cee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.432366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.432580:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304570624 00000100:00100000:3.0:1787395080.432589:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304570624 00000100:00100000:3.0:1787395080.432637:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 199 00000100:00100000:3.0:1787395080.432647:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+37:11545:x1874219304570624:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395080.432672:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.432705:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8d03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24bc expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432847:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432862:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432872:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432885:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432892:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.432898:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395080.433445:0:6624:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787395080.433597:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433608:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433617:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433646:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433662:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433668:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433673:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395080.433677:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433685:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433696:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395080.433699:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395080.433704:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433709:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395080.433721:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a87a9cd reply state 00000000b638b0ef transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.433729:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787395080.433754:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8d03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 40 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433768:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 39 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.433786:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:3.0:1787395080.433788:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395080.433791:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166a00, rc 0) 00000100:00100000:3.0:1787395080.433914:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+40:11545:x1874219304570624:12345-192.168.203.16@tcp:101:bash.0 Request processed in 1267us (1558us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787395080.433922:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 199 00010000:00010000:2.0:1787395080.436102:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436118:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436125:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436147:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.436153:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436160:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436175:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b308bf3700) 00010000:00010000:2.0:1787395080.436178:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.436181:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.436188:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8d11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.437760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.438033:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304570752 00000100:00100000:2.0:1787395080.438042:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304570752 00000100:00100000:2.0:1787395080.438107:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:2.0:1787395080.438117:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304570752:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395080.438134:0:8490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.438153:0:8490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24c3 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395080.438178:0:8490:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395080.438197:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:2.0:1787395080.438202:0:8490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395080.438210:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.438243:0:8490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 8 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.438255:0:8490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395080.438336:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304570752:12345-192.168.203.16@tcp:101:bash.0 Request processed in 220us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.438342:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00080000:0.0:1787395080.438622:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787395080.444390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.444537:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304570880 00000100:00100000:2.0:1787395080.444547:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304570880 00000100:00100000:2.0:1787395080.444610:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:2.0:1787395080.444620:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:11545:x1874219304570880:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395080.444637:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.444654:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24ca expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.444683:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.444692:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395080.444697:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395080.444701:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 9 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.444734:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.444766:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.444792:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323432320:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395080.445141:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b307a9fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395080.452749:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6602:1874219323432320:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395080.452790:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 9 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.452811:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48200, rc 0) 00000100:00100000:1.0:1787395080.452877:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+9:11545:x1874219304570880:12345-192.168.203.16@tcp:101:bash.0 Request processed in 8259us (8496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.452886:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:0.0:1787395080.455407:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.455509:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571008 00000100:00100000:1.0:1787395080.455518:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571008 00010000:00010000:1.0:1787395080.455569:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.455850:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:1.0:1787395080.455862:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302db1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304571008:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395080.455876:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395080.455898:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.455912:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.455964:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a8d26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24c3 expref: 9 pid: 8490 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.455980:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395080.455983:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395080.455991:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.456009:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395080.456045:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.456060:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1874219323432448:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395080.456143:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395080.460404:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.460486:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571264 00000100:00100000:3.0:1787395080.460496:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571264 00000100:00100000:3.0:1787395080.460551:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:3.0:1787395080.460561:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+39:11545:x1874219304571264:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:3.0:1787395080.460902:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+40:11545:x1874219304571264:12345-192.168.203.16@tcp:35:bash.0 Request processed in 341us (506us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787395080.460909:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787395080.463466:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341009f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5787:1874219323432448:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787395080.463492:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395080.463555:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302db1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304571008:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 7684us (8145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.463567:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395080.578798:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.578959:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571520 00000100:00100000:2.0:1787395080.578968:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571520 00000100:00100000:0.0:1787395080.578991:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.579035:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:2.0:1787395080.579045:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304571520:12345-192.168.203.16@tcp:16:kworker.0 00000100:00100000:1.0:1787395080.579096:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571392 00000100:00100000:1.0:1787395080.579101:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571392 00002000:00100000:1.0:1787395080.579126:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0b33f461c00 x1874219304571392/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:541/0 lens 504/0 e 0 to 0 dl 1787395091 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787395080.579151:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f461c00 with x1874219304571392 ext(0->8) 00002000:00010000:1.0:1787395080.579157:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0b33f461c00 00000100:00100000:1.0:1787395080.579176:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787395080.579177:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304571520:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 133us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395080.579182:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304571392:12345-192.168.203.16@tcp:4:bash.0 00000100:00100000:2.0:1787395080.579184:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:1.0:1787395080.579582:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+10:2363:x1874219304571392:12345-192.168.203.16@tcp:4:bash.0 Request processed in 399us (589us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787395080.579590:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00002000:00100000:1.0:1787395080.579609:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa0b33f461c00 x1874219304571392/t4294967308(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:541/0 lens 504/448 e 0 to 0 dl 1787395091 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787395080.579617:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33f461c00 with x1874219304571392 ext(0->8) 00002000:00010000:1.0:1787395080.579621:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa0b33f461c00 00010000:00010000:2.0:1787395080.658532:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395080.660907:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395080.660916:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395080.661145:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787395080.661151:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395080.680135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.680230:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571648 00000100:00100000:2.0:1787395080.680240:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571648 00000100:00100000:2.0:1787395080.680298:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 200 00000100:00100000:2.0:1787395080.680342:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+40:11561:x1874219304571648:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395080.680365:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.680386:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24d1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.680447:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.680459:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.680482:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.681195:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787395080.681200:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395080.681230:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.681258:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d1 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.681277:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d1 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.681286:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395080.681288:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395080.681292:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:2.0:1787395080.681411:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+41:11561:x1874219304571648:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1103us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.681420:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 200 00000100:00100000:0.0:1787395080.690192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.690284:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304571904 00000100:00100000:2.0:1787395080.690294:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304571904 00000100:00100000:2.0:1787395080.690374:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 201 00000100:00100000:2.0:1787395080.690385:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+41:11561:x1874219304571904:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395080.690405:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.690424:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24d8 expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.690559:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.690572:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.690583:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.690595:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787395080.690714:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d8 expref: 44 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.690731:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d8 expref: 43 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.690739:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:2.0:1787395080.690742:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395080.690745:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395080.690803:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+43:11561:x1874219304571904:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 419us (620us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787395080.690810:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 201 00000100:00100000:3.0:1787395080.694626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.694727:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572032 00000100:00100000:2.0:1787395080.694736:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572032 00000100:00100000:2.0:1787395080.694806:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787395080.694816:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+43:2364:x1874219304572032:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.694840:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395080.694870:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d8 expref: 43 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.694888:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:2.0:1787395080.694892:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395080.695058:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f432680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+42:2364:x1874219304572032:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 242us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.695066:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1787395080.697252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.697502:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572288 00000100:00100000:2.0:1787395080.697512:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572288 00000100:00100000:2.0:1787395080.697574:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 202 00000100:00100000:2.0:1787395080.697583:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+42:11561:x1874219304572288:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395080.697605:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.697625:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24df expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.697714:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.697727:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.697738:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.697750:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787395080.698085:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24df expref: 45 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.698119:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24df expref: 44 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.698128:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:2.0:1787395080.698130:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787395080.698133:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787395080.698194:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+44:11561:x1874219304572288:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 612us (948us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787395080.698202:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 202 00000100:00100000:0.0:1787395080.706128:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.706206:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572416 00000100:00100000:3.0:1787395080.706216:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572416 00000100:00100000:3.0:1787395080.706270:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:3.0:1787395080.706280:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+10:2363:x1874219304572416:12345-192.168.203.16@tcp:1:lfs.0 00010000:00010000:3.0:1787395080.706347:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.706369:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.706377:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395080.706393:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395080.706398:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.706432:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 10 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.706447:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 10 pid: 6602 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.706461:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323432576:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395080.706541:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395080.714673:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.714760:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572544 00000100:00100000:2.0:1787395080.714784:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572544 00010000:00010000:2.0:1787395080.714833:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 11 pid: 6602 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.714876:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:2.0:1787395080.714886:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+11:2363:x1874219304572544:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.714900:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787395080.714918:0:11522:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787395080.714921:0:11522:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787395080 00002000:00010000:2.0:1787395080.714923:0:11522:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787395080 00010000:00010000:2.0:1787395080.714928:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 11 pid: 6602 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.714940:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 11 pid: 6602 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.714990:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395080.715005:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395080.715010:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.715019:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.715039:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395080.715094:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+11:2363:x1874219304572544:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 209us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.715101:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00010000:00010000:0.0:1787395080.717847:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d519c36/0xedbabbe2e89a8d2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ca expref: 10 pid: 6602 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.717871:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f432d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6601:1874219323432576:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395080.717896:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.717907:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.717915:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.717965:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.717974:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.717987:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.718006:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395080.718011:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.718021:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.718039:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.718114:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093fa5d06/0xedbabbe2e89a8d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.718210:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+9:2363:x1874219304572416:12345-192.168.203.16@tcp:1:lfs.0 Request processed in 11930us (12088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.718220:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:0.0:1787395080.721258:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.721389:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572800 00000100:00100000:3.0:1787395080.721400:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572800 00000100:00100000:3.0:1787395080.721451:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787395080.721462:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+44:11561:x1874219304572800:12345-192.168.203.16@tcp:35:lfs.0 00000004:00010000:3.0:1787395080.721532:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24df expref: 44 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787395080.721793:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787395080.721855:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787395080.722174:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787395080.722224:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.722238:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 48 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.722266:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.722298:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 48 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.722348:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 48 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.722362:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f430e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323432704:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395080.722449:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395080.728174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395080.729508:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f430e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1874219323432704:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395080.729539:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.734655:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304572928 00000100:00100000:2.0:1787395080.734671:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304572928 00010000:00010000:2.0:1787395080.734718:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 49 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.734827:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1787395080.734837:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+49:2363:x1874219304572928:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.734872:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395080.734880:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 49 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734893:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 49 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734928:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8d18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24bc expref: 49 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734945:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:2.0:1787395080.734950:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734960:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734967:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.734991:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395080.735070:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+48:2363:x1874219304572928:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 233us (6903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.735078:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00010000:00010000:0.0:1787395080.735139:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.735156:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395080.735276:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1787395080.735511:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1787395080.735623:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f463800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323432832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787395080.735680:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395080.735708:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b305c5f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395080.735728:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323432832 00000100:00100000:0.0:1787395080.735732:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323432832 00000100:00100000:0.0:1787395080.735765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787395080.735772:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5806:x1874219323432832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787395080.735835:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5806:x1874219323432832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.735842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787395080.735879:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f463800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323432832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787395080.736294:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1787395080.736393:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f463800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323432960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787395080.736421:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395080.736437:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912d540 going to sleep for 11 seconds 00000100:00100000:0.0:1787395080.736450:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323432960 00000100:00100000:0.0:1787395080.736453:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323432960 00000100:00100000:0.0:1787395080.736473:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787395080.736478:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5806:x1874219323432960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787395080.736608:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5806:x1874219323432960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 129us (185us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787395080.736614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787395080.736655:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f463800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1874219323432960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787395080.736694:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787395080.736726:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736733:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736739:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736744:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395080.736748:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736754:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736768:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:0.0:1787395080.736771:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787395080.736775:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.736781:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8d73 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787395080.736922:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787395080.737029:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787395080.737040:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352685732425ns, next at 353685730614ns, rc = 0 00000001:00080000:0.0:1787395080.737046:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787395080.737075:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b308bf3600) 00010000:00010000:0.0:1787395080.737078:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787395080.737083:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8d5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24df expref: 52 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.737158:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+51:11561:x1874219304572800:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 15697us (15909us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787395080.737165:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000020:00080000:0.0:1787395080.737168:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787395080.741689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.741815:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304573056 00000100:00100000:2.0:1787395080.741825:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304573056 00000100:00100000:2.0:1787395080.741878:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 203 00000100:00100000:2.0:1787395080.741888:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+51:11561:x1874219304573056:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395080.741913:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.741933:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24e6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.741985:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24e6 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.742026:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24e6 expref: 52 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.742055:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.742058:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787395080.742062:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395080.742120:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+52:11561:x1874219304573056:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 233us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.742127:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 203 00000100:00100000:1.0:1787395080.748086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395080.748214:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304573312 00000100:00100000:0.0:1787395080.748224:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304573312 00000100:00100000:0.0:1787395080.748280:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787395080.748290:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+52:11561:x1874219304573312:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:0.0:1787395080.748814:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+53:11561:x1874219304573312:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 524us (735us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1787395080.748822:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787395080.786904:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787395080.786929:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323433088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395080.787007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395080.787132:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323433088 00000100:00100000:2.0:1787395080.787141:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323433088 00000100:00100000:2.0:1787395080.787198:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787395080.787208:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874219323433088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395080.787230:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395080.787268:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1874219323433088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.787275:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787395080.787502:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323433088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395080.839141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.839214:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304573440 00000100:00100000:2.0:1787395080.839223:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304573440 00000100:00100000:2.0:1787395080.839277:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 204 00000100:00100000:2.0:1787395080.839286:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+53:11571:x1874219304573440:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:2.0:1787395080.839369:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839386:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839411:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839426:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839432:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839438:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839526:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839535:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839541:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395080.839594:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839606:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839612:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839618:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839634:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.839638:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839646:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839657:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395080.839660:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.839663:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839668:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839681:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839686:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839691:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839695:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.839698:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839703:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839719:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395080.839721:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.839724:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839729:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839743:0:6624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839748:0:6624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839753:0:6624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839757:0:6624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.839759:0:6624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839764:0:6624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839770:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.839772:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.839775:0:6624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.839780:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.840055:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+53:11571:x1874219304573440:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 767us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.840064:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 204 00000001:00080000:0.0:1787395080.878072:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787395080.878091:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787395080.878112:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787395080.888355:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.888810:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304573696 00000100:00100000:2.0:1787395080.888819:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304573696 00000100:00100000:2.0:1787395080.889039:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 205 00000100:00100000:2.0:1787395080.889051:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+53:11574:x1874219304573696:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395080.889069:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395080.889090:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24ed expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889157:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889171:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889182:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889196:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889203:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889208:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889364:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889372:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889377:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395080.889386:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787395080.889478:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889487:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889493:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889499:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.889502:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889509:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889520:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:2.0:1787395080.889524:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.889528:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889661:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8d9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889677:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889682:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889688:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889692:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.889696:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889701:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889708:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395080.889710:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.889712:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889718:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889757:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889769:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.889782:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.889785:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395080.889787:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48a00, rc 0) 00000100:00100000:2.0:1787395080.890084:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+55:11574:x1874219304573696:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1035us (1736us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787395080.890092:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 205 00000100:00100000:3.0:1787395080.892383:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395080.892836:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304573824 00000100:00100000:1.0:1787395080.892844:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304573824 00000100:00100000:0.0:1787395080.893119:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 206 00000100:00100000:0.0:1787395080.893129:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+55:11574:x1874219304573824:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:0.0:1787395080.893205:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893220:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893230:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893254:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893261:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893267:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893273:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395080.893277:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893284:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893294:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395080.893297:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395080.893301:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.893338:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.893417:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+55:11574:x1874219304573824:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 289us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.893425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 206 00000100:00100000:3.0:1787395080.895381:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.895466:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574080 00000100:00100000:2.0:1787395080.895475:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574080 00000100:00100000:2.0:1787395080.895516:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:2.0:1787395080.895525:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+55:11574:x1874219304574080:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395080.895733:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+56:11574:x1874219304574080:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 208us (359us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787395080.895740:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:3.0:1787395080.968616:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.970676:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574336 00000100:00100000:2.0:1787395080.970689:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574336 00000100:00100000:3.0:1787395080.972353:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 207 00000100:00100000:3.0:1787395080.972366:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+56:11584:x1874219304574336:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395080.972391:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395080.972394:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787395080.972420:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24d1 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972456:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395080.972461:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395080.972474:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8dc0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24f4 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972639:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972653:0:6624:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972661:0:6624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972693:0:6624:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395080.972712:0:6624:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 56 pid: 5802 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395080.972725:0:6624:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f433b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323433216:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395080.972927:0:6624:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9240 going to sleep for 11 seconds 00000100:00100000:0.0:1787395080.974631:0:6624:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f433b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6624:1874219323433216:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395080.974658:0:6624:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.981802:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.981878:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574464 00000100:00100000:2.0:1787395080.981889:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574464 00010000:00010000:2.0:1787395080.981928:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 57 pid: 5802 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.981977:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:2.0:1787395080.981987:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+57:2363:x1874219304574464:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.982011:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395080.982018:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 57 pid: 5802 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982048:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 57 pid: 5802 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982070:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8dab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24ed expref: 57 pid: 5802 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982084:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.982089:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982099:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982107:0:11522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.982138:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395080.982192:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+56:2363:x1874219304574464:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 206us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.982199:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 00010000:00010000:0.0:1787395080.982382:0:6624:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.982391:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395080.982408:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787395080.982553:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8dc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 57 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.982569:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 56 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.982576:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395080.982579:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787395080.982581:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167800, rc 0) 00000100:00100000:0.0:1787395080.982619:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+56:11584:x1874219304574336:12345-192.168.203.16@tcp:101:bash.0 Request processed in 10255us (14011us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787395080.982626:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 207 00000100:00100000:1.0:1787395080.986123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395080.986193:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574720 00000100:00100000:0.0:1787395080.986215:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574720 00000100:00100000:0.0:1787395080.986269:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 208 00000100:00100000:0.0:1787395080.986277:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+56:11584:x1874219304574720:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:0.0:1787395080.986547:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.986563:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.986573:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395080.986623:0:11555:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787395080.986650:0:11555:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ee81d4d reply state 00000000e6c4c700 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.986659:0:11555:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395080.986745:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+59:11584:x1874219304574720:12345-192.168.203.16@tcp:36:bash.0 Request processed in 467us (629us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787395080.986752:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 208 00000020:00080000:0.0:1787395080.986757:0:11555:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395080.988220:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988233:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988241:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988264:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395080.988269:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988275:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988289:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.988293:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395080.988297:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.988303:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010600/0xedbabbe2e89a8dd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395080.989774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395080.989845:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574848 00000100:00100000:0.0:1787395080.989853:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574848 00000100:00100000:0.0:1787395080.989899:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00100000:0.0:1787395080.989909:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+58:11584:x1874219304574848:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1787395080.989930:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395080.989960:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8ddc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc24fb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.990044:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.990068:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 59 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.990077:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.990110:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 59 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.990124:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 59 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395080.990138:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433344:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395080.990212:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395080.996245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395080.996375:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304574976 00000100:00100000:0.0:1787395080.996382:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433344:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395080.996383:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304574976 00010000:00010000:0.0:1787395080.996411:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996417:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 60 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.996445:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395080.996455:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+60:2364:x1874219304574976:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395080.996468:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395080.996475:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 60 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996486:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 60 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996533:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8dc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24f4 expref: 60 pid: 6624 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996556:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395080.996561:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996570:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996577:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395080.996605:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395080.996649:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.996656:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395080.996659:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f432a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+59:2364:x1874219304574976:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 205us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395080.996666:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000004:00200000:0.0:1787395080.996699:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787395080.996703:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395080.996723:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.996763:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8ddc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.996777:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395080.996785:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395080.996796:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395080.996798:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011400, rc 0) 00000100:00100000:0.0:1787395080.996823:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+58:11584:x1874219304574848:12345-192.168.203.16@tcp:101:bash.0 Request processed in 6916us (7065us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395080.996839:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00100000:3.0:1787395081.003122:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.003271:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304575232 00000100:00100000:2.0:1787395081.003280:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304575232 00000100:00100000:2.0:1787395081.003386:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:2.0:1787395081.003397:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+58:11584:x1874219304575232:12345-192.168.203.16@tcp:35:bash.0 00000100:00080000:0.0:1787395081.003706:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395081.003961:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+59:11584:x1874219304575232:12345-192.168.203.16@tcp:35:bash.0 Request processed in 565us (847us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787395081.003969:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:1.0:1787395081.066084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395081.066188:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304575360 00000100:00100000:0.0:1787395081.066197:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304575360 00000100:00100000:0.0:1787395081.066257:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00100000:0.0:1787395081.066267:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+59:11590:x1874219304575360:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395081.066294:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395081.066367:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8dea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2502 expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066430:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066444:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066457:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395081.066521:0:6624:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787395081.066525:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395081.066556:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066581:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8dea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2502 expref: 61 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066599:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2502 expref: 60 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.066609:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395081.066612:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787395081.066615:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010000, rc 0) 00000100:00100000:0.0:1787395081.066674:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304575360:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 408us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395081.066682:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00100000:3.0:1787395081.072343:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.072462:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304575488 00000100:00100000:1.0:1787395081.072472:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304575488 00000100:00100000:1.0:1787395081.072536:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 211 00000100:00100000:1.0:1787395081.072556:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304575488:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395081.072573:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395081.072592:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8df8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2509 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072649:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072662:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072672:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072686:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072694:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072700:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072791:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072800:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072822:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395081.072866:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787395081.072870:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395081.072887:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072899:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072907:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072914:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072921:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072927:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.072931:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072938:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072960:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395081.072963:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.072968:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.072985:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073007:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073013:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073018:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073022:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.073024:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073029:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073037:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b318517200) 00010000:00010000:1.0:1787395081.073039:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.073042:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073048:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128800/0xedbabbe2e89a8e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073076:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a8df8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073091:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 61 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.073104:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:1.0:1787395081.073107:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395081.073109:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128e00, rc 0) 00000100:00100000:1.0:1787395081.073171:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+61:11590:x1874219304575488:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 626us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.073178:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 211 00000100:00100000:3.0:1787395081.077919:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395081.078037:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304575744 00000100:00100000:0.0:1787395081.078048:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304575744 00000100:00100000:0.0:1787395081.078110:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 212 00000100:00100000:0.0:1787395081.078121:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+61:11590:x1874219304575744:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1787395081.078141:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395081.078162:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2510 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078258:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078293:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078301:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078349:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078383:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 62 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078395:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 62 pid: 5803 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395081.078409:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433472:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395081.078497:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.078508:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395081.078516:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f462680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433600:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395081.078540:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119180 going to sleep for 11 seconds 00000100:00100000:3.0:1787395081.081398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395081.081515:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f460000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433472:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395081.082574:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304575872 00000100:00100000:2.0:1787395081.082583:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304575872 00010000:00010000:2.0:1787395081.082622:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 63 pid: 5803 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395081.082672:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:2.0:1787395081.082682:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+63:2364:x1874219304575872:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395081.082696:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395081.082703:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 63 pid: 5803 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.082714:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 63 pid: 5803 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.082735:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128e00/0xedbabbe2e89a8e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2509 expref: 63 pid: 5803 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.082752:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395081.082757:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.082766:0:11522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.082773:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395081.082821:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+62:2364:x1874219304575872:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 140us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.082840:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:0.0:1787395081.084243:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f462680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1874219323433600:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395081.084281:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395081.088889:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.088988:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576000 00000100:00100000:1.0:1787395081.089007:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576000 00010000:00010000:1.0:1787395081.089046:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.089085:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:1.0:1787395081.089095:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302db1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+62:2366:x1874219304576000:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395081.089109:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395081.089116:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089128:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089150:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a8de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24fb expref: 62 pid: 5804 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089165:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:1.0:1787395081.089169:0:5789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089191:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089200:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.089230:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395081.089284:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302db1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+61:2366:x1874219304576000:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 191us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.089291:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00010000:00010000:0.0:1787395081.089461:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.089471:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395081.089490:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787395081.089648:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.089662:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395081.089669:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395081.089672:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787395081.089674:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011600, rc 0) 00000100:00100000:0.0:1787395081.089699:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+61:11590:x1874219304575744:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 11581us (11791us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787395081.089706:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 212 00000100:00100000:1.0:1787395081.094394:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.100172:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576256 00000100:00100000:2.0:1787395081.100187:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576256 00000100:00100000:2.0:1787395081.100261:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:2.0:1787395081.100271:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+61:11590:x1874219304576256:12345-192.168.203.16@tcp:103:lfs.0 00010000:00010000:2.0:1787395081.100302:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395081.100346:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8d7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24e6 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.100366:0:11522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395081.100370:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395081.100435:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304576256:12345-192.168.203.16@tcp:103:lfs.0 Request processed in 165us (6049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.100442:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787395081.102475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.102791:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576384 00000100:00100000:2.0:1787395081.102800:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576384 00000100:00100000:2.0:1787395081.102859:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 213 00000100:00100000:2.0:1787395081.102870:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304576384:12345-192.168.203.16@tcp:58:lfs.0 00010000:00010000:2.0:1787395081.102969:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.102984:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.103004:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395081.103166:0:11555:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787395081.103249:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304576384:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 380us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.103257:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 213 00000100:00100000:3.0:1787395081.105075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.105212:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576512 00000100:00100000:2.0:1787395081.105221:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576512 00000100:00100000:2.0:1787395081.105282:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 214 00000100:00100000:2.0:1787395081.105291:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+60:11590:x1874219304576512:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395081.105327:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395081.105346:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2517 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105393:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105403:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105420:0:5802:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105433:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105445:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395081.105448:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787395081.105452:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.105460:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49400, rc 0) 00000100:00100000:2.0:1787395081.107815:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+61:11590:x1874219304576512:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 214us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.107844:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 214 00000040:00080000:0.0:1787395081.682614:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395081.682624:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395081.682969:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787395081.682977:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395081.683103:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f462680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323433728:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395081.683191:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3201190c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787395081.684352:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395081.686553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.687211:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576640 00000100:00100000:2.0:1787395081.687234:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576640 00000100:00100000:2.0:1787395081.687293:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:2.0:1787395081.687334:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304576640:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787395081.687368:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787395081.687494:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304576640:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 192us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.687502:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:3.0:1787395081.689351:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.689443:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304576768 00000100:00100000:1.0:1787395081.689452:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304576768 00000100:00100000:1.0:1787395081.689517:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 216 00000100:00100000:1.0:1787395081.689529:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304576768:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.689597:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.689613:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.689624:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.689935:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690058:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690080:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690107:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690116:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690123:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395081.690159:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787395081.690163:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395081.690174:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690182:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690188:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690194:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690199:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.690203:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690210:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690229:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:1.0:1787395081.690232:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.690236:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690240:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690254:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690260:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690266:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690270:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.690273:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690278:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690284:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa0b318517200) 00010000:00010000:1.0:1787395081.690286:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.690289:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690294:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690368:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690374:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690380:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690385:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.690388:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690394:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690402:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:1.0:1787395081.690404:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.690407:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.690424:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.690652:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304576768:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 1123us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.690662:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 216 00000100:00100000:0.0:1787395081.691157:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f462680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323433728:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787395081.701725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.702045:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304577024 00000100:00100000:2.0:1787395081.702057:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304577024 00000100:00100000:2.0:1787395081.702129:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 217 00000100:00100000:2.0:1787395081.702140:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+61:11591:x1874219304577024:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395081.702166:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395081.702189:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8e4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc251e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702293:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702329:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702341:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395081.702352:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787395081.702452:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702460:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702480:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702486:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395081.702490:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702497:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702517:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395081.702521:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787395081.702525:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702530:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702572:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8e4c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc251e expref: 63 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702582:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:2.0:1787395081.702584:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395081.702588:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8e4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc251e expref: 63 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.702597:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48600, rc 0) 00000100:00100000:2.0:1787395081.702658:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f527800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577024:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 520us (954us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787395081.702677:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 217 00000100:00100000:3.0:1787395081.706436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.706756:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304577152 00000100:00100000:2.0:1787395081.706765:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304577152 00000100:00100000:2.0:1787395081.706820:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:2.0:1787395081.706956:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577152:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787395081.707003:0:11555:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787395081.707148:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577152:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 206us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.707157:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:3.0:1787395081.716352:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.716540:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304577408 00000100:00100000:1.0:1787395081.716551:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304577408 00000100:00100000:1.0:1787395081.720893:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 219 00000100:00100000:1.0:1787395081.720918:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577408:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.721056:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395081.721060:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787395081.721089:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a8df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2502 expref: 62 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.721110:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395081.721115:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395081.721128:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2525 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787395081.721904:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787395081.722258:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.722272:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.722283:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.724647:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a8e61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2525 expref: 64 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.725061:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2525 expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.725071:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395081.725088:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395081.725091:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129c00, rc 0) 00000100:00100000:1.0:1787395081.725239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+63:11591:x1874219304577408:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 4333us (8895us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787395081.725248:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 219 00000100:00100000:0.0:1787395081.728766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.728870:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304577664 00000100:00100000:1.0:1787395081.728880:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304577664 00000100:00100000:1.0:1787395081.729055:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00100000:1.0:1787395081.729067:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+63:11591:x1874219304577664:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.729122:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395081.729149:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129c00/0xedbabbe2e89a8e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2525 expref: 63 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729169:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395081.729180:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395081.729200:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729213:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729224:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729238:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729245:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729269:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729377:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729385:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729392:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729399:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.729403:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729411:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729420:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:1.0:1787395081.729423:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.729426:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729432:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729441:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729447:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729459:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729465:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395081.729468:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729474:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729482:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf6e1c3b0 (ffffa0b318517a00) 00010000:00010000:1.0:1787395081.729485:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395081.729487:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.729493:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf6e1c3b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.729577:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577664:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 512us (819us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787395081.729584:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00100000:3.0:1787395081.732050:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.732197:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304577792 00000100:00100000:2.0:1787395081.732206:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304577792 00000100:00100000:2.0:1787395081.732264:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 221 00000100:00100000:2.0:1787395081.732274:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+62:11591:x1874219304577792:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395081.732293:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395081.732343:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8e84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc252c expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732378:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732391:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732401:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732722:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 64 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732746:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 63 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.732755:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395081.732758:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787395081.732761:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395081.733076:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+63:11591:x1874219304577792:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 802us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.733084:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 221 00000100:00100000:0.0:1787395081.736997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.738672:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578048 00000100:00100000:1.0:1787395081.738685:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578048 00000100:00100000:1.0:1787395081.738744:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 222 00000100:00100000:1.0:1787395081.738754:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+63:11591:x1874219304578048:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.738833:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.738848:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.738872:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787395081.739130:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787395081.739139:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353687831572ns, next at 354687829624ns, rc = 0 00000004:00010000:1.0:1787395081.739219:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061e8baf9 reply state 00000000b19bb916 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.739229:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395081.739846:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+65:11591:x1874219304578048:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 1090us (2863us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787395081.739854:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 222 00010000:00010000:2.0:1787395081.750980:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751007:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751015:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751021:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395081.751025:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751032:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751049:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395081.751052:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787395081.751057:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.751078:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128c00/0xedbabbe2e89a8e92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395081.753960:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.754054:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578176 00000100:00100000:1.0:1787395081.754063:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578176 00000100:00100000:1.0:1787395081.754118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 223 00000100:00100000:1.0:1787395081.754128:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+64:11591:x1874219304578176:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.754150:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395081.754170:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2533 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.754228:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 65 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.754242:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 65 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.754261:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:1.0:1787395081.754277:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395081.754285:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395081.754390:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+65:11591:x1874219304578176:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 262us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.754397:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 223 00000100:00100000:0.0:1787395081.758273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.758615:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578304 00000100:00100000:2.0:1787395081.758624:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578304 00000100:00100000:2.0:1787395081.758718:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:2.0:1787395081.758729:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304578304:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787395081.759006:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+10:2364:x1874219304578304:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 277us (740us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787395081.759014:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:0.0:1787395081.765718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395081.765978:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578560 00000100:00100000:3.0:1787395081.765997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578560 00000100:00100000:3.0:1787395081.766056:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:3.0:1787395081.766067:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+65:11591:x1874219304578560:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787395081.766286:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+66:11591:x1874219304578560:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 220us (576us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787395081.766295:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:0.0:1787395081.772751:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395081.772846:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578816 00000100:00100000:3.0:1787395081.772856:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578816 00000100:00100000:3.0:1787395081.772912:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:3.0:1787395081.772922:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+66:11591:x1874219304578816:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787395081.773049:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+66:11591:x1874219304578816:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 127us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395081.773057:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:1.0:1787395081.777286:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395081.777436:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304578944 00000100:00100000:3.0:1787395081.777446:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304578944 00000100:00100000:3.0:1787395081.777502:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 225 00000100:00100000:3.0:1787395081.777522:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+66:11591:x1874219304578944:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395081.777567:0:6624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395081.777587:0:6624:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8ea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc253a expref: -99 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777668:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777681:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777693:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395081.777726:0:6624:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395081.777743:0:6624:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777770:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc253a expref: 68 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777789:0:6624:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc253a expref: 67 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.777797:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:3.0:1787395081.777800:0:6624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395081.777804:0:6624:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166600, rc 0) 00000100:00100000:3.0:1787395081.778272:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+67:11591:x1874219304578944:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 759us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395081.778280:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 225 00000100:00100000:0.0:1787395081.782860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.783714:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579072 00000100:00100000:1.0:1787395081.783726:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579072 00000100:00100000:1.0:1787395081.783832:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:1.0:1787395081.783845:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+10:2364:x1874219304579072:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395081.783862:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395081.783880:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2541 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787395081.783906:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897c09, blocks: 0x1 00010000:00010000:1.0:1787395081.783929:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1787395081.783933:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395081.783951:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.783966:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.783978:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129600, rc 0) 00000100:00100000:1.0:1787395081.784066:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+11:2364:x1874219304579072:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 225us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.784085:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:0.0:1787395081.787097:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395081.787183:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579328 00000100:00100000:2.0:1787395081.787192:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579328 00000100:00100000:2.0:1787395081.787248:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 226 00000100:00100000:2.0:1787395081.787257:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+67:11591:x1874219304579328:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787395081.787386:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+67:11591:x1874219304579328:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 129us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.787395:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 226 00000100:00100000:2.0:1787395081.790401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395081.790545:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579456 00000100:00100000:3.0:1787395081.790554:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579456 00000100:00100000:3.0:1787395081.790605:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395081.790613:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+11:11591:x1874219304579456:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395081.790629:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395081.790646:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2548 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.790673:0:6599:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.790681:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395081.790685:0:6599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395081.790689:0:6599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.790719:0:6599:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.790731:0:6599:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395081.790745:0:6599:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f431880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323433856:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395081.790816:0:6599:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ce9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787395081.794248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395081.794368:0:6599:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f431880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6599:1874219323433856:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395081.794401:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 12 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.794448:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342166e00, rc 0) 00000100:00100000:3.0:1787395081.794514:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+12:11591:x1874219304579456:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 3894us (4114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395081.794524:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:1.0:1787395081.794768:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579584 00000100:00100000:1.0:1787395081.794775:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579584 00010000:00010000:1.0:1787395081.794807:0:5789:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.794851:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:1.0:1787395081.794860:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+12:2363:x1874219304579584:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395081.794873:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395081.794892:0:5789:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.794905:0:5789:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.794926:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058fa216a/0xedbabbe2e89a8eae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2541 expref: 12 pid: 6602 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.794950:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395081.794954:0:5789:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395081.794962:0:5789:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.794972:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.795028:0:5789:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 11 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395081.795041:0:5789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1874219323433984:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395081.795092:0:5789:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1540 going to sleep for 11 seconds 00000100:00100000:0.0:1787395081.799736:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.799839:0:5789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5789:1874219323433984:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787395081.799863:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395081.799917:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cada4208-c1d6-4319-a546-8bfc38316f45+11:2363:x1874219304579584:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 5057us (5675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395081.799926:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:2.0:1787395081.800411:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579712 00000100:00100000:2.0:1787395081.800428:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579712 00002000:00100000:2.0:1787395081.800470:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffffa0b33fed7480 x1874219304579712/t0(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:542/0 lens 504/0 e 0 to 0 dl 1787395092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395081.800480:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33fed7480 with x1874219304579712 ext(0->12) 00002000:00010000:2.0:1787395081.800485:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33fed7480 00000100:00100000:2.0:1787395081.800523:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395081.800545:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+11:2363:x1874219304579712:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787395081.802016:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:cada4208-c1d6-4319-a546-8bfc38316f45+13:2363:x1874219304579712:12345-192.168.203.16@tcp:4:lhsmtool_posix.0 Request processed in 1465us (2281us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787395081.802028:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00002000:00100000:2.0:1787395081.802038:0:6606:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffffa0b33fed7480 x1874219304579712/t4294967320(0) o4->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:542/0 lens 504/448 e 0 to 0 dl 1787395092 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787395081.802047:0:6606:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b33fed7480 with x1874219304579712 ext(0->12) 00002000:00010000:2.0:1787395081.802051:0:6606:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b33fed7480 00000100:00100000:0.0:1787395081.807336:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395081.807408:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579840 00000100:00100000:1.0:1787395081.807426:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579840 00000100:00100000:1.0:1787395081.807484:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 227 00000100:00100000:1.0:1787395081.807493:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+67:11591:x1874219304579840:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787395081.920998:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:1.0:1787395081.921021:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787395081.921037:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b32912d000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787395081.921041:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b329105a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b32912d6c0 00000020:00080000:1.0:1787395081.921045:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b329105800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b335fe3000 00000001:00080000:1.0:1787395081.921062:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1787395081.921066:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:1.0:1787395081.921077:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:1.0:1787395081.921111:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:1.0:1787395081.921145:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b302ce9900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787395081.921159:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b302ce9b40 00000020:00080000:1.0:1787395081.921162:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b33fea2400 00000020:00080000:1.0:1787395081.921275:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787395081.921456:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787395081.921527:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323434112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787395081.921589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395081.921661:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34101b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323434240:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787395081.923477:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:11591:x1874219304579840:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 115976us (116173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395081.923490:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 227 00000100:00100000:1.0:1787395081.924179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395081.924223:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395081.924233:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b341018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323434368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787395081.924253:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395081.924289:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323434112 00000100:00100000:1.0:1787395081.924296:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323434112 00000100:00100000:1.0:1787395081.924352:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323434240 00000100:00100000:1.0:1787395081.924355:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323434240 00000100:00100000:1.0:1787395081.924376:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323434368 00000100:00100000:1.0:1787395081.924379:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323434368 00000100:00100000:1.0:1787395081.924392:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787395081.924399:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323434112:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787395081.927367:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787395081.927386:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323434240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787395081.927432:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787395081.927458:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.927477:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.927486:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787395081.927491:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787395081.927495:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.927558:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 12 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.927572:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 12 pid: 6602 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395081.927586:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6602:1874219323434496:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395081.927662:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30b8f6e40 going to sleep for 11 seconds 00002000:00080000:1.0:1787395081.929530:0:6601:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1787395081.929576:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a897c08, atime: 0x0, ctime: 0x6a897c08, blocks: 0xb 00010000:00010000:1.0:1787395081.929585:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.929599:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1787395081.929604:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395081.929610:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.929637:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.929647:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.929654:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395081.929689:0:6601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787395081.930976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395081.931709:0:8490:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787395081.931722:0:8490:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:2.0:1787395081.932303:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395081.932345:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.932358:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395081.932363:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.932374:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.932395:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.932402:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058fa216a/0xedbabbe2e89a8ec3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395081.932456:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395081.932458:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395081.932460:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395081.932585:0:6599:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787395081.932596:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304579968 00000100:00100000:0.0:1787395081.932604:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304579968 00000100:00080000:0.0:1787395081.934492:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395081.935658:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6602:1874219323434496:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395081.935702:0:6602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395081.937383:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395081.937802:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787395081.937816:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3303:x1874219323434368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787395081.938038:0:12333:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787395081.938042:0:12333:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787395082 00002000:00010000:0.0:1787395081.938044:0:12333:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787395081.938047:0:12333:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787395081 -> 1787395082 00002000:00010000:0.0:1787395081.938049:0:12333:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787395081.938114:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341018700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3303:x1874219323434368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 302us (13860us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787395081.938122:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787395081.938150:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:0.0:1787395081.938158:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+13:2363:x1874219304579968:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1787395081.938720:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b341018000/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787395081.938728:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b341018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323434368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787395081.938888:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580096 00000100:00100000:3.0:1787395081.938895:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580096 00010000:00010000:3.0:1787395081.938923:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 14 pid: 6602 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395081.938969:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:3.0:1787395081.938977:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+14:2363:x1874219304580096:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395081.938997:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395081.939003:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 14 pid: 6602 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939017:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 14 pid: 6602 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939037:0:11522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa35b6f2/0xedbabbe2e89a8c7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc24a7 expref: 14 pid: 6602 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939051:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395081.939056:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395081.939070:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939078:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939105:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395081.939145:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+13:2363:x1874219304580096:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 168us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395081.939152:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00010000:00010000:3.0:1787395081.939252:0:6602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939262:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939272:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939279:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.939295:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787395081.942142:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323434112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17735us (20544us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787395081.942157:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787395081.942294:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787395081.942301:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:0.0:1787395081.942336:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b33ff3aa00, transno 4294967307 00000004:00080000:0.0:1787395081.942343:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787395081.942359:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0b3291b2680 x1874219323434112/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787395097 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787395081.942371:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b3291b2680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787395081.942377:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323434112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787395081.943037:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1874219323434240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15656us (18855us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787395081.943046:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1787395081.943072:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395081.943087:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.943098:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395081.943103:0:7492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.943113:0:7492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.943133:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.943140:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a8ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395081.943161:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395081.943163:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395081.943165:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787395081.947501:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b34101b100/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787395081.947516:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34101b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323434240:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787395082.021259:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1787395082.021285:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1787395082.021303:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1787395082.021580:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304579968:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 83417us (90604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395082.021592:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1787395082.025469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.026018:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580352 00000100:00100000:3.0:1787395082.026029:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580352 00000100:00100000:3.0:1787395082.026121:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 228 00000100:00100000:3.0:1787395082.026132:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+21:11591:x1874219304580352:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787395082.026190:0:6624:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395082.026230:0:6624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc253a expref: 21 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.026249:0:6624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:3.0:1787395082.026254:0:6624:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395082.026283:0:6624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.026296:0:6624:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.026349:0:6624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395082.026595:0:6624:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a21a5fe9 reply state 00000000cb4002af transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.026605:0:6624:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787395082.026752:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+22:11591:x1874219304580352:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 621us (1292us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787395082.026760:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 228 00010000:00010000:2.0:1787395082.032095:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032113:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032121:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032127:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395082.032132:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032140:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032170:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:2.0:1787395082.032172:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395082.032176:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.032182:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8eca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6624 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395082.032245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.032445:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580480 00000100:00100000:3.0:1787395082.032454:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580480 00000100:00100000:3.0:1787395082.032604:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:3.0:1787395082.032615:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304580480:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787395082.032818:0:6599:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787395082.032834:0:6599:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787395082 -> 1787395081 00002000:00010000:3.0:1787395082.032836:0:6599:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787395080 00002000:00010000:3.0:1787395082.032838:0:6599:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787395082 -> 1787395081 00002000:00010000:3.0:1787395082.032848:0:6599:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787395082.032954:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304580480:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 340us (711us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787395082.032962:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00080000:0.0:1787395082.033057:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395082.038918:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.039215:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580736 00000100:00100000:3.0:1787395082.039226:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580736 00000100:00100000:3.0:1787395082.039285:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 229 00000100:00100000:3.0:1787395082.039295:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+21:11591:x1874219304580736:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787395082.039378:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.039394:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.039403:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.039436:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.039450:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 21 pid: 11555 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.039464:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f433b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323434624:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395082.039547:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b305c9f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787395082.046294:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.047206:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f433b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323434624:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395082.047233:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395082.049919:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580864 00000100:00100000:0.0:1787395082.049933:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580864 00010000:00010000:1.0:1787395082.052596:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 22 pid: 11555 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.052653:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:1.0:1787395082.052664:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:2363:x1874219304580864:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395082.052680:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395082.052687:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 22 pid: 11555 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052720:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 22 pid: 11555 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052745:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc252c expref: 22 pid: 11555 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052762:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:1.0:1787395082.052767:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052776:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052783:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.052814:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395082.052878:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:2363:x1874219304580864:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 216us (6592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395082.052887:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 86 00010000:00010000:3.0:1787395082.053079:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053087:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053115:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053121:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053127:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053133:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395082.053137:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053143:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053152:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:3.0:1787395082.053154:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787395082.053158:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.053163:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8ed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.053202:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+20:11591:x1874219304580736:12345-192.168.203.16@tcp:55:lhsmtool_posix.0 Request processed in 13909us (14295us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787395082.053217:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 229 00000100:00100000:3.0:1787395082.055407:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395082.055695:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304580992 00000100:00100000:1.0:1787395082.055704:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304580992 00000100:00100000:1.0:1787395082.055759:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:1.0:1787395082.055768:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304580992:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787395082.055809:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.055858:0:6601:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.055866:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787395082.055870:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395082.055875:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.055921:0:6601:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 8 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.055935:0:6601:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 8 pid: 6599 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.056063:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323434752:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395082.056148:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395082.059242:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.059697:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304581120 00000100:00100000:3.0:1787395082.059706:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304581120 00010000:00010000:3.0:1787395082.059743:0:11522:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 9 pid: 6599 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.059790:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:3.0:1787395082.059800:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+9:2364:x1874219304581120:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395082.059813:0:11522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395082.059844:0:11522:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 9 pid: 6599 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.059859:0:11522:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 9 pid: 6599 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.059886:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395082.059890:0:11522:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395082.059895:0:11522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.059905:0:11522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.059928:0:11522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395082.060106:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e0374e/0xedbabbe2e89a8eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2548 expref: 9 pid: 6599 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.060121:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6601:1874219323434752:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395082.060139:0:6601:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060148:0:6601:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060166:0:6601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060187:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060194:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060205:0:6601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060213:0:6601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395082.060217:0:6601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060224:0:6601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060234:0:6601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.060241:0:6601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9498430/0xedbabbe2e89a8ed8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.060330:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2363:x1874219304580992:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 4563us (4933us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395082.060339:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:3.0:1787395082.060402:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304581120:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 604us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395082.060414:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:0.0:1787395082.063805:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395082.063924:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304581376 00000100:00100000:1.0:1787395082.063934:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304581376 00000100:00100000:1.0:1787395082.064007:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 230 00000100:00100000:1.0:1787395082.064018:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+20:11591:x1874219304581376:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787395082.064113:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064129:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064141:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064368:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064379:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064387:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064417:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.064447:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 21 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.064461:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323434880:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395082.064531:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395082.068269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.068470:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304581504 00000100:00100000:3.0:1787395082.068480:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304581504 00010000:00010000:3.0:1787395082.068517:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 22 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.068560:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:3.0:1787395082.068568:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:2364:x1874219304581504:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395082.068581:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395082.068587:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 22 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.068599:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 22 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.068620:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:3.0:1787395082.068625:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.068633:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.068640:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.068658:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395082.068704:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:2364:x1874219304581504:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 135us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395082.068726:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 88 00010000:00010000:1.0:1787395082.070682:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a8e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2533 expref: 21 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395082.070704:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323434880:192.168.203.16@tcp:104: 00010000:00010000:1.0:1787395082.070726:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.070735:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.070741:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395082.070923:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1787395082.071078:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1787395082.071122:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1787395082.071201:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323435008:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787395082.071255:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395082.071278:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787395082.071468:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323435008 00000100:00100000:0.0:1787395082.071475:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323435008 00000100:00100000:0.0:1787395082.071519:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787395082.071528:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323435008:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787395082.071619:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323435008:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395082.071627:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787395082.071850:0:5803:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787395082.071856:0:5803:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787395082.071872:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b341018000, transno 4294967321 00000100:00100000:3.0:1787395082.071890:0:5803:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa0b34101b100 x1874219323434240/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787395097 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395082.071901:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323435008:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787395082.073802:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787395082.077074:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f432d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323435136:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787395082.077153:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395082.077193:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787395082.077576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323435136 00000100:00100000:0.0:1787395082.077585:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323435136 00000100:00100000:0.0:1787395082.077635:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787395082.077658:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1874219323435136:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787395082.077922:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f46f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5803:x1874219323435136:12345-0@lo:1000:mdt00_001.0 Request processed in 265us (767us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787395082.077930:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787395082.078200:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f432d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1874219323435136:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787395082.078241:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078251:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078259:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078266:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395082.078270:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078278:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078331:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b3112e7d00) 00010000:00010000:3.0:1787395082.078335:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395082.078340:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078346:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128000/0xedbabbe2e89a8ee6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078376:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078383:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078388:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078392:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395082.078395:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078401:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078409:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395082.078411:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395082.078418:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078429:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078444:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.078489:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.078501:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323435264:192.168.203.16@tcp:105: 00000100:00100000:3.0:1787395082.078569:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b320119c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395082.081074:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1874219323435264:192.168.203.16@tcp:105: 00010000:00010000:3.0:1787395082.081103:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081112:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48a00/0xedbabbe2e89a8e29 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081140:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081153:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081163:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081173:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081178:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081196:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081203:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395082.081206:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081213:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081223:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395082.081226:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395082.081229:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081235:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8eed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081246:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081252:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081257:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081262:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395082.081265:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081282:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081290:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395082.081293:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787395082.081296:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.081301:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129400/0xedbabbe2e89a8edf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395082.081542:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+24:11591:x1874219304581376:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 17524us (17742us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787395082.081552:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 230 00000020:00080000:3.0:1787395082.081557:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787395082.082197:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395082.082202:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395082.082720:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787395082.082729:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395082.084765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.084850:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304581760 00000100:00100000:3.0:1787395082.084860:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304581760 00000100:00100000:3.0:1787395082.084911:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:3.0:1787395082.084921:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+24:11591:x1874219304581760:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787395082.085520:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787395082.085619:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787395082.085657:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085671:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085681:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085701:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085707:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085714:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.085730:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787395082.085800:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:11591:x1874219304581760:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 880us (1041us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787395082.085807:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000020:00080000:3.0:1787395082.085812:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787395082.085922:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395082.085929:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.085945:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395082.085949:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.085957:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.085969:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa0b308bf3e00) 00010000:00010000:1.0:1787395082.085972:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787395082.085976:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.085992:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8ef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395082.086009:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395082.086011:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395082.086013:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395082.091495:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.091678:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304581888 00000100:00100000:3.0:1787395082.091687:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304581888 00000100:00100000:3.0:1787395082.091741:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:3.0:1787395082.091751:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:11590:x1874219304581888:12345-192.168.203.16@tcp:49:lfs.0 00000100:00100000:3.0:1787395082.092102:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043bf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+26:11590:x1874219304581888:12345-192.168.203.16@tcp:49:lfs.0 Request processed in 352us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395082.092110:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:2.0:1787395082.100598:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.100673:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304582144 00000100:00100000:3.0:1787395082.100683:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304582144 00000100:00100000:3.0:1787395082.100883:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 231 00000100:00100000:3.0:1787395082.100896:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+26:11590:x1874219304582144:12345-192.168.203.16@tcp:58:lfs.0 00000040:00080000:3.0:1787395082.101140:0:6624:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787395082.101230:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+26:11590:x1874219304582144:12345-192.168.203.16@tcp:58:lfs.0 Request processed in 336us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395082.101251:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 231 00000100:00100000:0.0:1787395082.128952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395082.129551:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304582272 00000100:00100000:3.0:1787395082.129561:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304582272 00000100:00100000:3.0:1787395082.129617:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 232 00000100:00100000:3.0:1787395082.129625:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+26:11594:x1874219304582272:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1787395082.129643:0:11555:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395082.129662:0:11555:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc254f expref: -99 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129717:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129731:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129743:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129757:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129764:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.129770:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.130264:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.130286:0:11555:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395082.130294:0:11555:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.134106:0:11555:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.134129:0:11555:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 27 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395082.134206:0:11555:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323435392:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395082.134295:0:11555:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b305c9ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787395082.137948:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395082.138037:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304582528 00000100:00100000:0.0:1787395082.138046:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304582528 00000100:00100000:0.0:1787395082.138101:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:0.0:1787395082.138112:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+28:5577:x1874219304582528:12345-192.168.203.16@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787395082.138852:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+29:5577:x1874219304582528:12345-192.168.203.16@tcp:35:ldlm_bl.0 Request processed in 740us (909us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787395082.138859:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:2.0:1787395082.139066:0:11555:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107d880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11555:1874219323435392:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395082.139089:0:11555:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395082.143559:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395082.146492:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304582656 00000100:00100000:2.0:1787395082.146521:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304582656 00010000:00010000:2.0:1787395082.146566:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 29 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395082.146613:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:2.0:1787395082.146637:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302db0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:2364:x1874219304582656:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395082.146651:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395082.146658:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 29 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146676:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 29 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146697:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a8e1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2510 expref: 29 pid: 5804 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146714:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395082.146719:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146728:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146735:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395082.146769:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395082.146871:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302db0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cada4208-c1d6-4319-a546-8bfc38316f45+28:2364:x1874219304582656:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 234us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395082.146879:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 89 00010000:00010000:0.0:1787395082.147116:0:11555:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147124:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395082.147171:0:11555:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787395082.147176:0:11555:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395082.147194:0:11555:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147217:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147226:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147231:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147237:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147242:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395082.147246:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147252:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147261:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:0.0:1787395082.147264:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395082.147267:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147273:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166a00/0xedbabbe2e89a8f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147284:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147290:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147302:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147355:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395082.147358:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147365:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147374:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa0b308bf3300) 00010000:00010000:0.0:1787395082.147376:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395082.147379:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147385:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166e00/0xedbabbe2e89a8f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147419:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342166600/0xedbabbe2e89a8efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc254f expref: 28 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147432:0:11555:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc254f expref: 27 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395082.147438:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395082.147440:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787395082.147442:0:11555:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b342167800, rc 0) 00000100:00100000:0.0:1787395082.147472:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+27:11594:x1874219304582272:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 17848us (18539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395082.147488:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 232 00010000:00010000:1.0:1787395082.708592:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395083.090776:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395083.090786:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395083.090824:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787395083.090831:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395083.090954:0:11539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323435520:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395083.091061:0:11539:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b32912dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787395083.094642:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395083.094969:0:11539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11539:1874219323435520:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787395083.095688:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304582784 00000100:00100000:2.0:1787395083.095697:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304582784 00000100:00100000:2.0:1787395083.095877:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 233 00000100:00100000:2.0:1787395083.095887:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+27:11605:x1874219304582784:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787395083.095927:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787395083.096373:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+27:11605:x1874219304582784:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 149us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395083.096383:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 233 00000100:00080000:0.0:1787395083.107868:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395083.110796:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.111377:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583040 00000100:00100000:2.0:1787395083.111388:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583040 00000100:00100000:2.0:1787395083.111441:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 234 00000100:00100000:2.0:1787395083.111451:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+27:11605:x1874219304583040:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395083.111470:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395083.111488:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8f17 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2556 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.111580:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.111594:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.111608:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395083.111619:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787395083.112527:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48600/0xedbabbe2e89a8f17 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2556 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.112552:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2556 expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.112579:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395083.112582:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395083.112586:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48200, rc 0) 00000100:00100000:2.0:1787395083.112645:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+29:11605:x1874219304583040:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1195us (1859us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787395083.112653:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 234 00000100:00100000:2.0:1787395083.121395:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.121434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.121461:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583296 00000100:00100000:2.0:1787395083.121470:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583296 00000100:00100000:2.0:1787395083.121518:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 235 00000100:00100000:2.0:1787395083.121528:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:11605:x1874219304583296:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787395083.121605:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.121622:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.121633:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395083.122341:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583424 00000100:00100000:0.0:1787395083.122348:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583424 00000100:00100000:0.0:1787395083.122391:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787395083.122399:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+30:2363:x1874219304583424:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395083.122410:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395083.122428:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48200/0xedbabbe2e89a8f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2556 expref: 30 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.122444:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395083.122449:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395083.122500:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cada4208-c1d6-4319-a546-8bfc38316f45+29:2363:x1874219304583424:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 102us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395083.122508:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:2.0:1787395083.124106:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124122:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124129:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124142:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395083.124146:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124154:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124167:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395083.124170:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787395083.124175:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.124181:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49200/0xedbabbe2e89a8f2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395083.124354:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+29:11605:x1874219304583296:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 2824us (2915us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787395083.124365:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 235 00000040:00080000:1.0:1787395083.126255:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395083.126262:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395083.127140:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787395083.127151:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787395083.128121:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395083.129669:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583680 00000100:00100000:3.0:1787395083.129681:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583680 00000100:00100000:3.0:1787395083.129738:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:3.0:1787395083.129748:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+29:11605:x1874219304583680:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787395083.129964:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+30:11605:x1874219304583680:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 217us (1849us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787395083.129972:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:3.0:1787395083.137821:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395083.137865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395083.137895:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.137926:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584192 00000100:00100000:3.0:1787395083.137932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.137937:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584192 00000100:00100000:3.0:1787395083.137957:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583808 00000100:00100000:3.0:1787395083.137963:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583808 00000100:00100000:3.0:1787395083.138020:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 291 00000100:00100000:2.0:1787395083.138021:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:3.0:1787395083.138033:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304583808:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395083.138035:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304584192:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395083.138103:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304583808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395083.138111:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 291 00000100:00100000:3.0:1787395083.138140:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304583936 00000100:00100000:3.0:1787395083.138148:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304583936 00000100:00100000:3.0:1787395083.138168:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584064 00000100:00100000:3.0:1787395083.138170:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584064 00000100:00100000:3.0:1787395083.138186:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:3.0:1787395083.138192:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304583936:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395083.138217:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304583936:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395083.138222:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304584192:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 189us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395083.138230:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:2.0:1787395083.138236:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:3.0:1787395083.138245:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:3.0:1787395083.138254:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304584064:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:2.0:1787395083.138264:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787395083.138271:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395083.138278:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304584064:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395083.138286:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000040:00080000:1.0:1787395083.159621:0:12371:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395083.159630:0:12371:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395083.159673:0:12371:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787395083.159685:0:12371:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787395083.329670:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395083.329748:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584448 00000100:00100000:2.0:1787395083.329758:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584448 00000100:00100000:2.0:1787395083.329827:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 236 00000100:00100000:2.0:1787395083.329837:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+30:11618:x1874219304584448:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395083.329859:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395083.329878:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8f33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc255d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.329969:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8f3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.329994:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8f3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.330006:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8f3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395083.330018:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787395083.330125:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49600/0xedbabbe2e89a8f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc255d expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.330141:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8f3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc255d expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.330150:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:2.0:1787395083.330153:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787395083.330156:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49e00, rc 0) 00000100:00100000:2.0:1787395083.330209:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+32:11618:x1874219304584448:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 374us (547us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787395083.330216:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 236 00000100:00100000:2.0:1787395083.334220:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395083.334438:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584576 00000100:00100000:0.0:1787395083.334447:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584576 00000100:00100000:0.0:1787395083.334527:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:0.0:1787395083.334551:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:11618:x1874219304584576:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:0.0:1787395083.334612:0:11555:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334628:0:11555:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334641:0:11555:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334665:0:11555:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334672:0:11555:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334678:0:11555:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334684:0:11555:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395083.334689:0:11555:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334696:0:11555:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334708:0:11555:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:0.0:1787395083.334712:0:11555:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787395083.334716:0:11555:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395083.334722:0:11555:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a8f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11555 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395083.334987:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+32:11618:x1874219304584576:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 437us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395083.334996:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:0.0:1787395083.405505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395083.408101:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584704 00000100:00100000:1.0:1787395083.408116:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584704 00000100:00100000:2.0:1787395083.413012:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:2.0:1787395083.413029:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3390d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304584704:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:2.0:1787395083.413048:0:6601:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395083.413081:0:6601:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8f4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2564 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395083.413109:0:6601:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a897c09, atime: 0x6a897c08, ctime: 0x6a897c09, blocks: 0xb 00010000:00010000:2.0:1787395083.413129:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1787395083.413134:0:6601:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395083.413144:0:6601:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2564 expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.413162:0:6601:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8f4f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2564 expref: 8 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395083.413175:0:6601:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49600, rc 0) 00000100:00100000:2.0:1787395083.413245:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3390d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+8:2364:x1874219304584704:12345-192.168.203.16@tcp:101:cat.0 Request processed in 221us (7750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395083.413252:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:1.0:1787395083.423620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395083.423780:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584832 00000100:00100000:0.0:1787395083.423790:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584832 00002000:00100000:0.0:1787395083.423842:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffffa0b327e74a80 x1874219304584832/t0(0) o3->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:544/0 lens 488/0 e 0 to 0 dl 1787395094 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395083.423854:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b327e74a80 with x1874219304584832 ext(0->4095) 00002000:00010000:0.0:1787395083.423860:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b327e74a80 00000100:00100000:0.0:1787395083.423891:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395083.423900:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2365:x1874219304584832:12345-192.168.203.16@tcp:3:cat.0 00000100:00100000:0.0:1787395083.424139:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:cada4208-c1d6-4319-a546-8bfc38316f45+8:2365:x1874219304584832:12345-192.168.203.16@tcp:3:cat.0 Request processed in 239us (528us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787395083.424147:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00002000:00100000:0.0:1787395083.424153:0:6607:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffffa0b327e74a80 x1874219304584832/t0(0) o3->cada4208-c1d6-4319-a546-8bfc38316f45@192.168.203.16@tcp:544/0 lens 488/4536 e 0 to 0 dl 1787395094 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787395083.424161:0:6607:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b327e74a80 with x1874219304584832 ext(0->4095) 00002000:00010000:0.0:1787395083.424165:0:6607:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b327e74a80 00010000:00010000:3.0:1787395083.731044:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395084.755744:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395084.883008:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323435648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395084.883083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395084.883154:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323435648 00000100:00100000:1.0:1787395084.883162:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323435648 00000100:00100000:1.0:1787395084.883212:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787395084.883221:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323435648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787395084.883254:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395084.883297:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323435648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395084.883304:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1787395084.883346:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395084.883391:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323435648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395085.394752:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323436032:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.394820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395085.394885:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787395085.394892:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323435904:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.394932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395085.394950:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323436416:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.394986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395085.395034:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436032 00000100:00100000:0.0:1787395085.395042:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436032 00000100:00100000:0.0:1787395085.395091:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323435904 00000100:00100000:0.0:1787395085.395094:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323435904 00000100:00100000:0.0:1787395085.395113:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787395085.395122:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323436032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.395185:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323436032:12345-0@lo:400:kworker.0 Request processed in 63us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395085.395192:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787395085.395209:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787395085.395215:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323435904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.395242:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323435904:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395085.395247:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787395085.395269:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436416 00000100:00100000:0.0:1787395085.395272:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436416 00000100:00100000:0.0:1787395085.395301:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787395085.395340:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323436416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.395369:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323436416:12345-0@lo:400:kworker.0 Request processed in 62us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395085.395376:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787395085.395392:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395085.395397:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395085.395436:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323435904:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.395475:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323436416:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.395484:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323436032:0@lo:400:kworker.0 00000100:00100000:3.0:1787395085.396002:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323435776:0@lo:400:kworker.0 00000100:00100000:3.0:1787395085.396056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395085.396092:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323436288:0@lo:400:kworker.0 00000100:00100000:3.0:1787395085.396118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395085.396145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787395085.396151:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323436160:0@lo:400:kworker.0 00000100:00100000:3.0:1787395085.396174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395085.396285:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323435776 00000100:00100000:2.0:1787395085.396290:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323435776 00000100:00100000:2.0:1787395085.396353:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787395085.396361:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323435776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395085.396405:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323435776:12345-0@lo:400:kworker.0 Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395085.396421:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787395085.396479:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323435776:0@lo:400:kworker.0 00000100:00100000:1.0:1787395085.396718:0:12333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436160 00000100:00100000:1.0:1787395085.396723:0:12333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436160 00000100:00100000:1.0:1787395085.396761:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787395085.396768:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323436160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395085.396810:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1874219323436160:12345-0@lo:400:kworker.0 Request processed in 42us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395085.396816:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787395085.396840:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323436160:0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.397039:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436288 00000100:00100000:0.0:1787395085.397043:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436288 00000100:00100000:0.0:1787395085.397090:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787395085.397097:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323436288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395085.397136:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323436288:12345-0@lo:400:kworker.0 Request processed in 40us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395085.397143:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1787395085.397253:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395085.397276:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323436288:0@lo:400:kworker.0 00010000:00010000:3.0:1787395085.786171:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395085.907559:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323436544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395085.907634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395085.907696:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436544 00000100:00100000:1.0:1787395085.907704:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436544 00000100:00100000:1.0:1787395085.907747:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787395085.907755:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323436544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787395085.907785:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395085.907826:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874219323436544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395085.907833:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787395085.907875:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323436544:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1787395085.997962:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1787395086.802892:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787395087.036338:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:1.0:1787395087.036374:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1787395087.036395:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787395087.036418:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa0b305c9f180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787395087.036424:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa0b305c9f000 00000020:00080000:1.0:1787395087.036427:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffffa0b318c69e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa0b302c24800 00000020:00080000:3.0:1787395087.036618:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787395087.036839:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1787395087.493601:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1787395087.493618:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:1.0:1787395087.826549:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395088.261235:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.261268:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.261291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.261323:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.261345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.261367:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585216 00000100:00100000:0.0:1787395088.261377:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585216 00000100:00100000:0.0:1787395088.261456:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585344 00000100:00100000:0.0:1787395088.261460:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585344 00000100:00100000:0.0:1787395088.261487:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395088.261497:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304585216:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395088.261776:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+7:2363:x1874219304585216:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 278us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.261784:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395088.261802:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:0.0:1787395088.261810:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304585344:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395088.261853:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2363:x1874219304585344:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.261859:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:0.0:1787395088.261879:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585472 00000100:00100000:0.0:1787395088.261882:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585472 00000100:00100000:0.0:1787395088.261911:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585088 00000100:00100000:0.0:1787395088.261914:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585088 00000100:00100000:0.0:1787395088.261935:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:0.0:1787395088.261954:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304585472:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395088.261981:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2363:x1874219304585472:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 40us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.261988:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 146 00000100:00100000:0.0:1787395088.262001:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 147 00000100:00100000:0.0:1787395088.262007:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33fed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:2363:x1874219304585088:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395088.262032:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33fed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cada4208-c1d6-4319-a546-8bfc38316f45+19:2363:x1874219304585088:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.262038:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 147 00000100:00100000:1.0:1787395088.263573:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304584960 00000100:00100000:1.0:1787395088.263584:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304584960 00000100:00100000:1.0:1787395088.263644:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 293 00000100:00100000:1.0:1787395088.263652:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304584960:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395088.263719:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2363:x1874219304584960:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395088.263727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 293 00000100:00080000:1.0:1787395088.263759:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787395088.263765:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787395088.263768:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395088.316987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.317179:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585600 00000100:00100000:0.0:1787395088.317190:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585600 00000100:00100000:0.0:1787395088.317255:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:0.0:1787395088.317266:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:11279:x1874219304585600:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787395088.317401:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:11279:x1874219304585600:12345-192.168.203.16@tcp:60:lhsmtool_posix.0 Request processed in 136us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.317409:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:1.0:1787395088.326291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395088.326404:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585856 00000100:00100000:3.0:1787395088.326426:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585856 00000100:00100000:3.0:1787395088.326483:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1787395088.326494:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:11279:x1874219304585856:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787395088.327113:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+20:11279:x1874219304585856:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 619us (828us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787395088.327122:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:1.0:1787395088.588050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395088.588138:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304585984 00000100:00100000:0.0:1787395088.588171:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304585984 00000100:00100000:0.0:1787395088.588233:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 239 00000100:00100000:0.0:1787395088.588242:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+5:12069:x1874219304585984:12345-192.168.203.16@tcp:101:lsof.0 00010000:00010000:0.0:1787395088.588260:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395088.588278:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8f56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc256b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588379:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588392:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588404:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395088.588622:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787395088.588626:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787395088.588706:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588732:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011a00/0xedbabbe2e89a8f56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc256b expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588748:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc256b expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395088.588756:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:0.0:1787395088.588759:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787395088.588763:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011c00, rc 0) 00000100:00100000:0.0:1787395088.588830:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:12069:x1874219304585984:12345-192.168.203.16@tcp:101:lsof.0 Request processed in 588us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395088.588837:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 239 00010000:00010000:3.0:1787395088.850540:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395089.874844:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395090.002781:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787395090.002813:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323436672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395090.002874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395090.002948:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436672 00000100:00100000:1.0:1787395090.002955:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436672 00000100:00100000:1.0:1787395090.003003:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787395090.003011:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323436672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787395090.003044:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395090.003084:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323436672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395090.003091:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1787395090.003112:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395090.003137:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787395090.003141:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b34101b100, transno 4294967322 00000004:00080000:1.0:1787395090.003151:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787395090.003178:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323436672:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787395090.324274:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787395090.324282:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395090.324623:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787395090.324630:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787395090.514555:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323437056:0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.514624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395090.514689:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787395090.514696:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323436928:0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.514716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395090.514729:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323437440:0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.514747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395090.514793:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437056 00000100:00100000:0.0:1787395090.514800:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437056 00000100:00100000:0.0:1787395090.514854:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436928 00000100:00100000:0.0:1787395090.514858:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436928 00000100:00100000:0.0:1787395090.514879:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787395090.514885:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.514938:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323437056:12345-0@lo:400:kworker.0 Request processed in 42us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395090.514946:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787395090.514964:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787395090.514969:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323436928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.514995:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323436928:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395090.515017:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:0.0:1787395090.515038:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395090.515069:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323436928:0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.515080:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323437056:0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515163:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437440 00000100:00100000:2.0:1787395090.515168:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437440 00000100:00100000:2.0:1787395090.515205:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787395090.515212:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323437440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515247:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323437440:12345-0@lo:400:kworker.0 Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395090.515253:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787395090.515272:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323437184:0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395090.515342:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787395090.515348:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33fed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323436800:0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395090.515406:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323437312:0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395090.515449:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323436800 00000100:00100000:2.0:1787395090.515452:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323436800 00000100:00100000:2.0:1787395090.515479:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787395090.515485:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323436800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515517:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323436800:12345-0@lo:400:kworker.0 Request processed in 32us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395090.515523:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787395090.515547:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437312 00000100:00100000:2.0:1787395090.515551:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437312 00000100:00100000:2.0:1787395090.515583:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787395090.515588:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323437312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515618:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874219323437312:12345-0@lo:400:kworker.0 Request processed in 30us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395090.515624:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787395090.515649:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323436800:0@lo:400:kworker.0 00000100:00100000:2.0:1787395090.515658:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323437312:0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.516590:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437184 00000100:00100000:0.0:1787395090.516598:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437184 00000100:00080000:1.0:1787395090.516726:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787395090.516732:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395090.516784:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787395090.516793:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323437184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395090.516860:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34107dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323437184:12345-0@lo:400:kworker.0 Request processed in 68us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395090.516866:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787395090.517551:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33fed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323437184:0@lo:400:kworker.0 00000100:00100000:3.0:1787395090.517600:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787395090.517604:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa0b3291b2680, transno 4294967310 00000100:00100000:3.0:1787395090.517616:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323437440:0@lo:400:kworker.0 00010000:00010000:1.0:1787395090.898731:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395091.030627:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323437568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395091.030697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395091.031110:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437568 00000100:00100000:2.0:1787395091.031119:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437568 00000100:00100000:2.0:1787395091.031184:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787395091.031200:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323437568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395091.031238:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395091.031303:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323437568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395091.031347:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787395091.031389:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323437568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787395091.923880:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787395092.126080:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787395092.126092:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787395092.126682:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787395092.126692:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1787395092.946561:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395093.381803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395093.381890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395093.381935:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395093.381954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395093.381990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395093.382081:0:12333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586368 00000100:00100000:2.0:1787395093.382092:0:12333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586368 00000100:00100000:2.0:1787395093.382153:0:12333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586496 00000100:00100000:2.0:1787395093.382157:0:12333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586496 00000100:00100000:2.0:1787395093.382183:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395093.382194:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304586368:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395093.382264:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+7:2366:x1874219304586368:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395093.382272:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395093.382289:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:2.0:1787395093.382296:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304586496:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395093.382368:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+5:2366:x1874219304586496:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395093.382375:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00080000:3.0:1787395093.384628:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395093.384638:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395093.385454:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586624 00000100:00100000:2.0:1787395093.385536:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586624 00000100:00100000:2.0:1787395093.385591:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586240 00000100:00100000:2.0:1787395093.385594:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586240 00000100:00100000:2.0:1787395093.385623:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:2.0:1787395093.385632:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:2366:x1874219304586624:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395093.385727:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:907adeaf-e431-466d-a504-1dc9d988b548+6:2366:x1874219304586624:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395093.385734:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:2.0:1787395093.385979:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:2.0:1787395093.385988:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+19:2366:x1874219304586240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395093.386024:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cada4208-c1d6-4319-a546-8bfc38316f45+19:2366:x1874219304586240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 37us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395093.386031:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 152 00000100:00100000:0.0:1787395093.388875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586112 00000100:00100000:0.0:1787395093.388889:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586112 00000100:00080000:3.0:1787395093.388913:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395093.389010:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 295 00000100:00100000:2.0:1787395093.389023:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304586112:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395093.389135:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2366:x1874219304586112:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 115us (7339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395093.389143:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 295 00000001:02000400:1.0:1787395093.951701:0:12577:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:38:12 (1787395092) 00010000:00010000:1.0:1787395093.978333:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395094.997140:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395095.124478:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787395095.124509:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323437696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395095.124600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.124761:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437696 00000100:00100000:2.0:1787395095.124773:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437696 00000100:00100000:2.0:1787395095.124876:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787395095.124887:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323437696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395095.124942:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395095.124997:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323437696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395095.125005:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787395095.125063:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323437696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787395095.125257:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395095.647270:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323438080:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.647270:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323437824:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.648173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.648247:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323438336:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.648284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.648344:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787395095.648352:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323438208:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.648382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.648422:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323437952:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.648450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.648501:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438208 00000100:00100000:2.0:1787395095.648510:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438208 00000100:00100000:2.0:1787395095.648578:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437952 00000100:00100000:2.0:1787395095.648582:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437952 00000100:00100000:2.0:1787395095.648606:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787395095.648615:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323438208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395095.648662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395095.648675:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323438208:12345-0@lo:400:kworker.0 Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395095.648684:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787395095.648702:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438080 00000100:00100000:3.0:1787395095.648708:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787395095.648714:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438080 00000100:00100000:3.0:1787395095.648715:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323437952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395095.648830:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323437824 00000100:00100000:1.0:1787395095.648835:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323437824 00000100:00100000:1.0:1787395095.648880:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787395095.648888:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323437824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395095.648935:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3306:x1874219323437824:12345-0@lo:400:kworker.0 Request processed in 47us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395095.648941:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:1.0:1787395095.648973:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395095.649074:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787395095.649082:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323438080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395095.649083:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323437952:12345-0@lo:400:kworker.0 Request processed in 369us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395095.649090:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787395095.649168:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323437952:0@lo:400:kworker.0 00000100:00100000:0.0:1787395095.649408:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438336 00000100:00100000:0.0:1787395095.649414:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438336 00000100:00100000:0.0:1787395095.649456:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787395095.649464:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323438336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395095.649508:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323438336:12345-0@lo:400:kworker.0 Request processed in 44us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395095.649515:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787395095.649833:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395095.658404:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323438080:12345-0@lo:400:kworker.0 Request processed in 9306us (9725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395095.658425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787395095.658530:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323438208:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.658557:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34107c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3306:1874219323437824:0@lo:400:kworker.0 00000100:00100000:2.0:1787395095.658574:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323438336:0@lo:400:kworker.0 00000100:00100000:3.0:1787395095.660845:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323438080:0@lo:400:kworker.0 00010000:00010000:3.0:1787395096.018512:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395096.151173:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323438464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395096.151293:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395096.151408:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438464 00000100:00100000:1.0:1787395096.151418:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438464 00000100:00100000:1.0:1787395096.151475:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787395096.151485:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323438464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787395096.151530:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395096.151581:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323438464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395096.151600:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787395096.152666:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323438464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787395097.044741:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395098.067547:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395098.503257:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.503409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.503447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.503466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395098.503582:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304587264 00000100:00100000:1.0:1787395098.503590:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304587264 00000100:00100000:1.0:1787395098.503641:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586880 00000100:00100000:1.0:1787395098.503644:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586880 00000100:00100000:1.0:1787395098.503665:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 156 00000100:00100000:1.0:1787395098.503674:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:907adeaf-e431-466d-a504-1dc9d988b548+6:2364:x1874219304587264:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395098.503750:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:907adeaf-e431-466d-a504-1dc9d988b548+6:2364:x1874219304587264:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.503758:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 156 00000100:00100000:1.0:1787395098.503774:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 157 00000100:00100000:1.0:1787395098.503779:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+19:2364:x1874219304586880:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395098.503801:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:cada4208-c1d6-4319-a546-8bfc38316f45+19:2364:x1874219304586880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.503807:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 157 00000100:00080000:1.0:1787395098.503823:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395098.504145:0:8490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304587008 00000100:00100000:3.0:1787395098.504150:0:8490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304587008 00000100:00100000:3.0:1787395098.504194:0:8490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:3.0:1787395098.504202:0:8490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304587008:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395098.504236:0:8490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cada4208-c1d6-4319-a546-8bfc38316f45+7:2364:x1874219304587008:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395098.504242:0:8490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00080000:1.0:1787395098.504483:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787395098.506815:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395098.506968:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304587136 00000100:00100000:1.0:1787395098.506977:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304587136 00000100:00100000:1.0:1787395098.507045:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:1.0:1787395098.507055:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304587136:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395098.507119:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cada4208-c1d6-4319-a546-8bfc38316f45+5:2364:x1874219304587136:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.507127:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00080000:2.0:1787395098.507999:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395098.510128:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304586752 00000100:00100000:0.0:1787395098.510141:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304586752 00000100:00100000:0.0:1787395098.510202:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 297 00000100:00100000:0.0:1787395098.510212:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304586752:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395098.510303:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2364:x1874219304586752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (7055us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395098.510336:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 297 00000100:00100000:2.0:1787395098.640797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395098.640915:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304587520 00000100:00100000:3.0:1787395098.640925:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304587520 00000100:00100000:3.0:1787395098.640985:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1787395098.640995:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+19:12292:x1874219304587520:12345-192.168.203.16@tcp:35:umount.0 00000100:00100000:3.0:1787395098.642133:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+20:12292:x1874219304587520:12345-192.168.203.16@tcp:35:umount.0 Request processed in 1134us (1340us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787395098.642143:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1787395098.649023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.649383:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304587776 00000100:00100000:2.0:1787395098.649398:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304587776 00000100:00100000:2.0:1787395098.649473:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:2.0:1787395098.649484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+20:12292:x1874219304587776:12345-192.168.203.16@tcp:35:umount.0 00000100:00100000:2.0:1787395098.651341:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+21:12292:x1874219304587776:12345-192.168.203.16@tcp:35:umount.0 Request processed in 1799us (2273us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787395098.651359:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:1.0:1787395098.656109:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395098.656405:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588032 00000100:00100000:3.0:1787395098.656418:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588032 00000100:00100000:3.0:1787395098.656495:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:3.0:1787395098.656506:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3043be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+21:12292:x1874219304588032:12345-192.168.203.16@tcp:35:umount.0 00000100:00100000:3.0:1787395098.658500:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3043be850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cada4208-c1d6-4319-a546-8bfc38316f45+22:12292:x1874219304588032:12345-192.168.203.16@tcp:35:umount.0 Request processed in 1982us (2394us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787395098.658515:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:1.0:1787395098.663198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.664047:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588288 00000100:00100000:2.0:1787395098.664062:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588288 00000100:00100000:2.0:1787395098.664159:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1787395098.664170:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+22:12292:x1874219304588288:12345-192.168.203.16@tcp:35:umount.0 00000100:00100000:2.0:1787395098.664683:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cada4208-c1d6-4319-a546-8bfc38316f45+23:12292:x1874219304588288:12345-192.168.203.16@tcp:35:umount.0 Request processed in 512us (1495us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787395098.664694:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1787395098.682914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.683070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.683100:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.683149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.683183:0:12333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588800 00000100:00100000:1.0:1787395098.683183:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588416 00000100:00100000:2.0:1787395098.683194:0:12333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588800 00000100:00100000:1.0:1787395098.683194:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588416 00000100:00100000:1.0:1787395098.683248:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588672 00000100:00100000:1.0:1787395098.683252:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588672 00000100:00100000:2.0:1787395098.683255:0:12333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:1.0:1787395098.683263:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304588544 00000100:00100000:2.0:1787395098.683264:0:12333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+5:2362:x1874219304588800:12345-192.168.203.16@tcp:9:umount.0 00000100:00100000:1.0:1787395098.683265:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304588544 00000100:00100000:1.0:1787395098.683278:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787395098.683284:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+15:2365:x1874219304588416:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395098.683300:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395098.683360:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167a00/0xedbabbe2e89a7fd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20f6 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395098.683382:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395098.683447:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+14:2365:x1874219304588416:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 162us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.683456:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787395098.683474:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:1.0:1787395098.683480:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+13:2365:x1874219304588672:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395098.683487:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395098.683496:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa49000/0xedbabbe2e89a81e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21c1 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395098.683505:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395098.683530:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:2365:x1874219304588672:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 40us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.683537:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:1.0:1787395098.683573:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787395098.683579:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2365:x1874219304588544:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395098.683586:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395098.683595:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa49800/0xedbabbe2e89a7f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20be expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395098.683604:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395098.683619:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2365:x1874219304588544:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 40us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395098.683625:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000020:00000080:2.0:1787395098.684007:0:12333:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a82ad 00000100:00080000:2.0:1787395098.684021:0:12333:0:(import.c:65:import_set_state_nolock()) ffffa0b339226800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787395098.684070:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787395098.684079:0:12333:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787395098.685722:0:12333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:cada4208-c1d6-4319-a546-8bfc38316f45+2:2362:x1874219304588800:12345-192.168.203.16@tcp:9:umount.0 Request processed in 2434us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395098.685740:0:12333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:2.0:1787395098.701803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395098.701974:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304589184 00000100:00100000:3.0:1787395098.701986:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304589184 00000100:00100000:3.0:1787395098.702065:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:3.0:1787395098.702076:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+7:2362:x1874219304589184:12345-192.168.203.16@tcp:9:umount.0 00000020:00000080:3.0:1787395098.702117:0:6602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a850e 00000020:00010000:3.0:1787395098.702128:0:6602:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0b318c9f000: total 0 00000100:00080000:3.0:1787395098.702134:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa0b318c98000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787395098.702195:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1787395098.702992:0:5791:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0b318c9f000: total 0 00010000:00010000:2.0:1787395098.703043:0:5791:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0b318c9f000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787395098.703118:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a8f4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2564 expref: 7 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395098.703160:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ad89ee3/0xedbabbe2e89a88b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2396 expref: 6 pid: 6601 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395098.703197:0:5791:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0b318c9f000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787395098.703211:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395098.703214:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395098.703216:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395098.703469:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cada4208-c1d6-4319-a546-8bfc38316f45+2:2362:x1874219304589184:12345-192.168.203.16@tcp:9:umount.0 Request processed in 1392us (1679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395098.703480:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:1.0:1787395098.714201:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395098.714485:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304590208 00000100:00100000:2.0:1787395098.714500:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304590208 00000100:00100000:2.0:1787395098.714695:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 240 00000100:00100000:2.0:1787395098.714953:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+23:2362:x1874219304590208:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:2.0:1787395098.715004:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f49 00000020:00010000:2.0:1787395098.715026:0:6624:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0b318da7800: total 0 00000100:00080000:2.0:1787395098.715032:0:6624:0:(import.c:65:import_set_state_nolock()) ffffa0b318da3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787395098.715070:0:6624:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787395098.716071:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0b318da7800: total 0 00010000:00010000:3.0:1787395098.716146:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0b318da7800, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787395098.716189:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395098.716193:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787395098.716206:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49a00/0xedbabbe2e89a889c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc238f expref: 22 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716235:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395098.716257:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395098.716263:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b342167800/0xedbabbe2e89a8f10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc254f expref: 21 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716281:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:3.0:1787395098.716283:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395098.716287:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a8913 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b2 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716301:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00000100:00100000:2.0:1787395098.716470:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cada4208-c1d6-4319-a546-8bfc38316f45+19:2362:x1874219304590208:12345-192.168.203.16@tcp:39:umount.0 Request processed in 1763us (2281us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787395098.716481:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 240 00010000:00010000:3.0:1787395098.716607:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787395098.716614:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49e00/0xedbabbe2e89a8f3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc255d expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716633:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395098.716635:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395098.716639:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010400/0xedbabbe2e89a8872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2381 expref: 17 pid: 11555 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716654:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:3.0:1787395098.716657:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395098.716660:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010800/0xedbabbe2e89a8213 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21cf expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716679:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395098.716681:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787395098.716684:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129200/0xedbabbe2e89a8c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc248b expref: 15 pid: 6624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716723:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395098.716727:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787395098.716731:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b300030600/0xedbabbe2e89a8570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc22bd expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716754:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa0b318946400) 00010000:00010000:3.0:1787395098.716757:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787395098.716761:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010c00/0xedbabbe2e89a892f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc23b9 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716777:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395098.716780:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395098.716784:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d000/0xedbabbe2e89a8792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2349 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716796:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa0b318517000) 00010000:00010000:3.0:1787395098.716798:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395098.716802:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128400/0xedbabbe2e89a8880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2388 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716818:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa0b3112e7a00) 00010000:00010000:3.0:1787395098.716820:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787395098.716957:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa48c00/0xedbabbe2e89a8283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21eb expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.716986:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa0b3112e7400) 00010000:00010000:3.0:1787395098.716989:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395098.717002:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49400/0xedbabbe2e89a8e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2517 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.717022:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b3112e7600) 00010000:00010000:3.0:1787395098.717024:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395098.717028:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33fa49c00/0xedbabbe2e89a822f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21d6 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395098.717042:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0b318da7800, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787395098.717069:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395098.717072:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395098.717074:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395099.093402:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395100.114546:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395100.243869:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323438592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395100.243937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395100.244688:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438592 00000100:00100000:1.0:1787395100.244753:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438592 00000100:00100000:1.0:1787395100.244825:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787395100.244835:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323438592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787395100.244876:0:6604:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787395100.244984:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395100.245612:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323438592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 777us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395100.245618:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787395100.247206:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323438592:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787395100.563580:0:11539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787395100.563589:0:11539:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787395100.564211:0:11539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787395100.564219:0:11539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787395100.755459:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323438976:0@lo:400:kworker.0 00000100:00100000:1.0:1787395100.755545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395100.755624:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395100.755631:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323439104:0@lo:400:kworker.0 00000100:00100000:1.0:1787395100.755655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395100.755716:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323438848:0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.755784:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323438720:0@lo:400:kworker.0 00000100:00100000:3.0:1787395100.759046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395100.760328:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438976 00000100:00100000:2.0:1787395100.760341:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438976 00000100:00100000:2.0:1787395100.760395:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439104 00000100:00100000:2.0:1787395100.760398:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439104 00000100:00100000:2.0:1787395100.760415:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438848 00000100:00100000:2.0:1787395100.760417:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438848 00000100:00100000:2.0:1787395100.760432:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787395100.763170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395100.763228:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323439232:0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.763267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395100.763327:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323438720 00000100:00100000:0.0:1787395100.763335:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323438720 00000100:00100000:0.0:1787395100.763574:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787395100.763583:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323438720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.763636:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323438720:12345-0@lo:400:kworker.0 Request processed in 54us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.763643:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787395100.763674:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439232 00000100:00100000:0.0:1787395100.763679:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439232 00000100:00100000:0.0:1787395100.764179:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787395100.764189:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323439232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.764231:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323439232:12345-0@lo:400:kworker.0 Request processed in 45us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.764237:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787395100.764292:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323438720:0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.764329:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323439232:0@lo:400:kworker.0 00000100:00100000:2.0:1787395100.764367:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323438976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.764416:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787395100.764418:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323438976:12345-0@lo:400:kworker.0 Request processed in 3977us (8871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.764429:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323439104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.764470:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323439104:12345-0@lo:400:kworker.0 Request processed in 45us (8815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.764476:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787395100.764489:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787395100.764496:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323438848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395100.764539:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323438848:12345-0@lo:400:kworker.0 Request processed in 43us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.764546:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1787395100.764578:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395100.764584:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395100.764653:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787395100.764700:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323438848:0@lo:400:kworker.0 00000100:00100000:1.0:1787395100.765293:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323439104:0@lo:400:kworker.0 00000100:00100000:1.0:1787395100.765318:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323438976:0@lo:400:kworker.0 00000100:00100000:1.0:1787395100.881336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395100.881380:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395100.881503:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395100.890839:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304590336 00000100:00100000:0.0:1787395100.890863:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304590336 00000100:00100000:0.0:1787395100.890944:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304590592 00000100:00100000:0.0:1787395100.890948:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304590592 00000100:00100000:0.0:1787395100.890964:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304590464 00000100:00100000:0.0:1787395100.890967:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304590464 00000100:00100000:0.0:1787395100.890987:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:0.0:1787395100.890996:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+12:2363:x1874219304590336:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395100.891010:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395100.891030:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167400/0xedbabbe2e89a801b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc210b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395100.891047:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395100.891104:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+11:2363:x1874219304590336:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 109us (9807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.891128:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:0.0:1787395100.891147:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:0.0:1787395100.891153:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+10:2363:x1874219304590592:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395100.891161:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395100.891170:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48400/0xedbabbe2e89a81e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc21ba expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395100.891180:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395100.891198:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+9:2363:x1874219304590592:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 46us (9818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.891204:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:0.0:1787395100.891215:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:0.0:1787395100.891221:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+8:2363:x1874219304590464:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395100.891228:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395100.891236:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a8022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2135 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395100.891244:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395100.891261:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302db3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0257003-6b52-426f-9d71-ce21fcfcd00e+7:2363:x1874219304590464:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 39us (9758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395100.891267:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:1.0:1787395100.899082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395100.902794:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304590848 00000100:00100000:0.0:1787395100.902809:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304590848 00000100:00080000:2.0:1787395100.902965:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395100.905513:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 241 00000100:00100000:0.0:1787395100.905537:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+6:2362:x1874219304590848:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:0.0:1787395100.905599:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a8030 00000020:00010000:0.0:1787395100.905608:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0b33fb49800: total 0 00000100:00080000:0.0:1787395100.905612:0:5803:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787395100.905642:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787395100.905842:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:907adeaf-e431-466d-a504-1dc9d988b548+5:2362:x1874219304590848:12345-192.168.203.16@tcp:39:umount.0 Request processed in 315us (6769us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787395100.905850:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 241 00000020:00010000:3.0:1787395100.906127:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0b33fb49800: total 0 00010000:00010000:3.0:1787395100.906132:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395100.906173:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0b33fb49800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787395100.906204:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b318946d00) 00010000:00010000:3.0:1787395100.906207:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395100.906216:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011c00/0xedbabbe2e89a8f5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc256b expref: 4 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395100.906239:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0b33fb49800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787395100.906250:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395100.906252:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395100.906253:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395100.934356:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395100.934707:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591104 00000100:00100000:2.0:1787395100.934716:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591104 00000100:00100000:2.0:1787395100.934766:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 299 00000100:00100000:2.0:1787395100.934776:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+7:2362:x1874219304591104:12345-192.168.203.16@tcp:251:umount.0 00000020:00000080:2.0:1787395100.934818:0:5797:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f26 00000020:00010000:2.0:1787395100.934825:0:5797:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0b33fb4c800: total 0 00000100:00080000:2.0:1787395100.934830:0:5797:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb48000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787395100.934922:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b318a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0257003-6b52-426f-9d71-ce21fcfcd00e+3:2362:x1874219304591104:12345-192.168.203.16@tcp:251:umount.0 Request processed in 146us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395100.934930:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 299 00000020:00010000:1.0:1787395100.935037:0:7492:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0b33fb4c800: total 0 00010000:00010000:1.0:1787395100.935076:0:7492:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0b33fb4c800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787395100.935107:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a7fdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc20fd expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395100.935121:0:7492:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0b33fb4c800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787395100.935130:0:7492:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4c800/c0257003-6b52-426f-9d71-ce21fcfcd00e 00010000:00010000:1.0:1787395100.935146:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395100.935148:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395100.935150:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787395100.935896:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4c800/c0257003-6b52-426f-9d71-ce21fcfcd00e for MGS 00000020:00000080:2.0:1787395100.935929:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fb48000 for MGS 00010000:00010000:2.0:1787395101.142158:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395101.268516:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787395101.268550:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323439360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395101.268647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395101.272796:0:6603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439360 00000100:00100000:3.0:1787395101.272832:0:6603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439360 00000100:00100000:3.0:1787395101.272910:0:6603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787395101.277595:0:6603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323439360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787395101.277755:0:6603:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395101.277905:0:6603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323439360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4981us (9254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395101.277916:0:6603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787395101.278072:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323439360:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787395101.357191:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:2.0:1787395101.357204:0:7503:0:(genops.c:906:class_export_put()) final put ffffa0b339220800/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:2.0:1787395101.357243:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b339220800/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-OST0001 00000020:00000080:2.0:1787395101.357292:0:12633:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b339226800 for lustre-OST0001 00010000:00010000:3.0:1787395102.163475:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787395102.360910:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 907adeaf-e431-466d-a504-1dc9d988b548 00000001:00080000:2.0:1787395102.361008:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787395102.361015:0:5825:0:(genops.c:906:class_export_put()) final put ffffa0b33fb49800/907adeaf-e431-466d-a504-1dc9d988b548 00000020:00000080:1.0:1787395102.361280:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb49800/907adeaf-e431-466d-a504-1dc9d988b548 for lustre-MDT0000 00000020:00000080:1.0:1787395102.361376:0:12633:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fb4b800 for lustre-MDT0000 00000001:00100000:2.0:1787395102.361472:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000001:00080000:2.0:1787395102.361480:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1787395102.361877:0:5825:0:(genops.c:906:class_export_put()) final put ffffa0b318da7800/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:1.0:1787395102.367826:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318da7800/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-MDT0000 00000020:00000080:0.0:1787395102.368014:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b318da3000 for lustre-MDT0000 00000001:00100000:1.0:1787395102.927583:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:1.0:1787395102.927803:0:6626:0:(genops.c:906:class_export_put()) final put ffffa0b318c9f000/cada4208-c1d6-4319-a546-8bfc38316f45 00000020:00000080:2.0:1787395102.927877:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318c9f000/cada4208-c1d6-4319-a546-8bfc38316f45 for lustre-OST0000 00000020:00000080:2.0:1787395102.927942:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b318c98000 for lustre-OST0000 00010000:00010000:1.0:1787395103.188777:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787395103.400638:0:12781:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787395103.411454:0:12781:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787395103.411604:0:12781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.411618:0:12781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.411625:0:12781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.411632:0:12781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.411653:0:12781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787395103.411658:0:12781:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787395103.411804:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395103.411811:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395103.411819:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342167e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395103.411824:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395103.411832:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395103.411853:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395103.411859:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787395103.411862:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787395103.411865:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787395103.411907:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395103.411913:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787395103.411944:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395103.411951:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342167e00/0xedbabbe2e89a7fab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fb2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395103.411962:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395103.411962:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787395103.411965:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395103.411981:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395103.411984:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323439488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787395103.412051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395103.412127:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439488 00000100:00100000:0.0:1787395103.412134:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439488 00000100:00100000:0.0:1787395103.412188:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787395103.412200:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3304:x1874219323439488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395103.412214:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395103.412228:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a7fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7fab expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.412239:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395103.412270:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:3304:x1874219323439488:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395103.412276:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787395103.412324:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323439488:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787395103.412619:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787395103.412623:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787395103.412629:0:12781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787395103.412642:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b33600b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787395103.412988:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323439616:0@lo:39:umount.0 00000100:00100000:0.0:1787395103.413024:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395103.413118:0:6624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439616 00000100:00100000:2.0:1787395103.413124:0:6624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439616 00000100:00100000:2.0:1787395103.413206:0:6624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787395103.413213:0:6624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874219323439616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787395103.413235:0:6624:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7d35 00000100:00080000:2.0:1787395103.413242:0:6624:0:(import.c:65:import_set_state_nolock()) ffffa0b32edea000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787395103.413334:0:6624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1874219323439616:12345-0@lo:39:umount.0 Request processed in 119us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395103.413353:0:6624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787395103.413364:0:6624:0:(genops.c:906:class_export_put()) final put ffffa0b32edef800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787395103.413417:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787395103.413444:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b33600b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787395103.413455:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323439616:0@lo:39:umount.0 00000020:00000080:3.0:1787395103.413637:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b32edef800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787395103.413754:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b32edea000 for lustre-MDT0000 00000100:00080000:2.0:1787395103.413801:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787395103.413804:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787395103.413808:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787395103.414939:0:12781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.414955:0:12781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.414962:0:12781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.414968:0:12781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.414993:0:12781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395103.414999:0:12781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415006:0:12781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415011:0:12781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415017:0:12781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415138:0:12781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787395103.415147:0:12781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415153:0:12781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415158:0:12781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.415164:0:12781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415203:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787395103.415210:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415216:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395103.415220:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415229:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395103.415235:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395103.415241:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787395103.415244:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787395103.415271:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415277:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395103.415329:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415336:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b341010e00/0xedbabbe2e89a7fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7fc0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415349:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395103.415352:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415358:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395103.415362:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415368:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395103.415373:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395103.415378:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787395103.415380:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787395103.415382:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787395103.415395:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415401:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395103.415414:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415421:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031e00/0xedbabbe2e89a7ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7ee7 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415444:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395103.415447:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415453:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395103.415456:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415463:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395103.415469:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395103.415474:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787395103.415476:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1787395103.415485:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415490:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395103.415495:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415501:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395103.415503:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395103.415504:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395103.415530:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323439872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395103.415580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395103.415620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787395103.415631:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323440000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395103.415648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395103.415671:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439872 00000100:00100000:3.0:1787395103.415677:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439872 00000100:00100000:3.0:1787395103.415771:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323440000 00000100:00100000:3.0:1787395103.415774:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323440000 00000100:00100000:3.0:1787395103.415788:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787395103.415796:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+19:3305:x1874219323439872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395103.415806:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395103.415818:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b300031c00/0xedbabbe2e89a7ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7ee0 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415831:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395103.415875:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+18:3305:x1874219323439872:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395103.415882:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787395103.415896:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787395103.415901:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+17:3305:x1874219323440000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395103.415907:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395103.415915:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a81db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a81d4 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.415924:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395103.415939:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3305:x1874219323440000:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395103.415944:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787395103.415960:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787395103.415967:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323439744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395103.415994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395103.416023:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323440000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395103.416030:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3305:1874219323439872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395103.416047:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323439744 00000100:00100000:3.0:1787395103.416049:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323439744 00000100:00100000:3.0:1787395103.416066:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787395103.416071:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+16:3303:x1874219323439744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395103.416077:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395103.416084:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a7fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7fb9 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395103.416091:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395103.416113:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:3303:x1874219323439744:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395103.416119:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787395103.416137:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323439744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787395103.416361:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395103.416634:0:12781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787395103.416640:0:12781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c200/0xedbabbe2e89a81d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a81db expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395103.416650:0:12781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787395103.416657:0:12781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.416665:0:12781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.416672:0:12781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395103.416678:0:12781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.416774:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395103.416780:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.416787:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b300031800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395103.416791:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.416798:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395103.416804:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395103.416810:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787395103.416813:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1787395103.416827:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.416833:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787395103.416866:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.416874:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395103.416880:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395103.416881:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395103.416911:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395103.416923:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33f460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323440128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395103.416952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395103.417014:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323440128 00000100:00100000:0.0:1787395103.417018:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323440128 00000100:00100000:0.0:1787395103.417051:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787395103.417056:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+15:3304:x1874219323440128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395103.417064:0:5789:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395103.417075:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b30148ec00/0xedbabbe2e89a7c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7c94 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.417089:0:5789:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395103.417118:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8581b891-0741-4f4a-b0af-8eaaf7ff17d5+14:3304:x1874219323440128:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395103.417124:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787395103.417147:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33f460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323440128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395103.417243:0:12781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787395103.417248:0:12781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b300031800/0xedbabbe2e89a7c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7c9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395103.417258:0:12781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1787395103.417262:0:12781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787395103.417264:0:12781:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1787395103.417288:0:12781:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1787395103.417291:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1787395103.417296:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.417301:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787395103.417331:0:12781:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0b336750800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787395103.417337:0:12781:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa0b305dd4000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787395103.417342:0:12781:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffffa0b3367d3380) has exports, disconnecting them 00000020:00080000:2.0:1787395103.417346:0:12781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0b336750800), last request at 1787395100 00000020:00000080:2.0:1787395103.417352:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7ea8 00000100:00080000:2.0:1787395103.417364:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b336752000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787395103.417446:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787395103.417584:0:12781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b336750800): rc 0 00000020:00000080:2.0:1787395103.417586:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b336750800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1787395103.417599:0:12781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffffa0b305dd4000), last request at 1787395100 00000020:00000080:2.0:1787395103.417602:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7ddd 00000100:00080000:2.0:1787395103.417608:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b318c23000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787395103.417632:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b336750800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787395103.417669:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b336752000 for lustre-MDT0000 00010000:00010000:1.0:1787395103.417781:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787395103.417825:0:12781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b305dd4000): rc 0 00000020:00000080:2.0:1787395103.417827:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b305dd4000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787395103.417869:0:12781:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba80c1df7ae0 00000100:00080000:2.0:1787395103.417887:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787395103.417891:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787395103.417913:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787395103.417975:0:12781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787395103.417987:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787395103.418000:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787395103.418002:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787395103.418007:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787395103.418074:0:12781:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787395103.418081:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b318da1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787395103.418107:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa0b3367d3380) has no exports 00010000:00010000:0.0:1787395103.418165:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395103.418175:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323440256:0@lo:9:umount.0 00000100:00100000:0.0:1787395103.418208:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395103.418233:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323440384:0@lo:9:umount.0 00000100:00100000:0.0:1787395103.418250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787395103.418383:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305dd4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787395103.418412:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b318c23000 for lustre-MDT0000 00000100:00100000:1.0:1787395103.418597:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323440256 00000100:00100000:1.0:1787395103.418603:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323440256 00000100:00100000:1.0:1787395103.418648:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323440384 00000100:00100000:1.0:1787395103.418650:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323440384 00000100:00100000:1.0:1787395103.418665:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787395103.418672:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874219323440256:12345-0@lo:9:umount.0 00000100:00080000:0.0:1787395103.418768:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395103.418772:0:5798:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395103.418783:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787395103.418790:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874219323440384:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787395103.418807:0:6599:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f1f 00000100:00080000:0.0:1787395103.418813:0:6599:0:(import.c:65:import_set_state_nolock()) ffffa0b33fb4d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787395103.418855:0:6599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787395103.419155:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3302:x1874219323440384:12345-0@lo:9:umount.0 Request processed in 364us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395103.419163:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787395103.419197:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b318da1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787395103.419207:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787395103.419209:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787395103.419212:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323440384:0@lo:9:umount.0 00010000:00010000:0.0:1787395103.419231:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787395103.419297:0:6601:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7e2a 00000100:00080000:1.0:1787395103.419338:0:6601:0:(import.c:65:import_set_state_nolock()) ffffa0b33fa89800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787395103.419365:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:3.0:1787395103.419599:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395103.420159:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3302:x1874219323440256:12345-0@lo:9:umount.0 Request processed in 1485us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395103.420166:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787395103.420237:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787395103.420253:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787395103.420255:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787395103.420258:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323440256:0@lo:9:umount.0 00000020:00080000:3.0:1787395103.430463:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa0b3367d3380) has no exports 00000020:00000080:3.0:1787395103.491734:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7cef 00000020:00000080:3.0:1787395103.491750:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b33600d800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787395103.491773:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787395103.491872:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33600d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787395103.492528:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.492539:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787395103.492544:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffffa0b3367d0000) has no exports 00000020:00000080:2.0:1787395103.497246:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7ce8 00000020:00000080:2.0:1787395103.497260:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b33a489800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787395103.497353:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.497363:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787395103.497366:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3367ec000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787395103.497369:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3367ec000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787395103.497380:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787395103.497812:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33a489800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787395103.497884:0:12781:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b340df5120 - data ffffa0b333f91a20/ffffa0b33fe9c400 00000020:01000000:2.0:1787395103.498026:0:12781:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b30522e960 - data ffffa0b333f6f870/ffffa0b32956f000 00000001:00000004:2.0:1787395103.510502:0:12781:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787395103.558207:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787395103.558215:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787395103.558237:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787395103.558241:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787395103.558975:0:6963:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787395103.558979:0:6963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787395103.558992:0:6963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787395103.559900:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787395103.559905:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787395103.559923:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787395103.559926:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787395103.560241:0:7879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787395103.560245:0:7879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787395103.560252:0:7879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787395103.609972:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7cb7 00000020:00000080:2.0:1787395103.609983:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3292c9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787395103.610053:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3292c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787395103.617440:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7ccc 00000020:00000080:2.0:1787395103.617453:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3367e8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787395103.617632:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787395103.617638:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.617645:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787395103.617649:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffffa0b3367d4d40) has no exports 00000004:01000000:2.0:1787395103.618097:0:12781:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787395103.618107:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f0a 00000020:00000080:2.0:1787395103.618111:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b336750000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787395103.621769:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3367e8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787395103.621903:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787395103.621914:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.621925:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787395103.621931:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffffa0b3411d0000) has no exports 00000020:00000080:2.0:1787395103.621941:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7f03 00000020:00000080:2.0:1787395103.621954:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b318da4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787395103.621992:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b336750000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787395103.622250:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318da4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787395103.622685:0:12781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787395103.622689:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787395103.622693:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787395103.622698:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787395103.622701:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787395103.622732:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.622739:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787395103.622745:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7e23 00000020:00000080:2.0:1787395103.622750:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b329232800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787395103.622754:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787395103.622758:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.622762:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787395103.622765:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffffa0b31810cd40) has no exports 00000020:00000080:2.0:1787395103.622770:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7e1c 00000020:00000080:2.0:1787395103.622773:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b329230000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787395103.622933:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b318da1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787395103.622941:0:8:0:(genops.c:906:class_export_put()) final put ffffa0b336751800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787395103.622944:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b336751800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787395103.622955:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787395103.623016:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b329232800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787395103.623020:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b329230000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787395103.623389:0:12781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787395103.623393:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787395103.623395:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787395103.623399:0:12781:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787395103.623401:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787395103.623428:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.623433:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787395103.623459:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.623469:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787395103.623472:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3292cf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787395103.623475:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3292cf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787395103.623481:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787395103.623601:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7cd3 00000020:00000080:2.0:1787395103.623606:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3367ee800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787395103.623610:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787395103.623613:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.623617:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787395103.623619:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffffa0b3367d19c0) has no exports 00000020:00000080:2.0:1787395103.623637:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.623640:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787395103.623643:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7cda 00000020:00000080:2.0:1787395103.623646:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3367ef800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787395103.623652:0:12781:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b318a89000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787395103.623655:0:12781:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b318a89000 3 00000020:01000004:2.0:1787395103.623657:0:12781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0b318a89000 from lustre-MDT0000 00000020:00000080:2.0:1787395103.623674:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.623677:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787395103.623680:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b3292ca800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787395103.623682:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3292ca800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787395103.623689:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787395103.623712:0:12781:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787395103.623716:0:12781:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787395103.623718:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787395103.623721:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787395103.623724:0:12781:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1787395103.623725:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b302d9f800 for lustre-OST0000-osc-MDT0000 00000020:00080000:2.0:1787395103.623731:0:12781:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffffa0b3292cc000 8581b891-0741-4f4a-b0af-8eaaf7ff17d5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1787395103.623731:0:8:0:(genops.c:906:class_export_put()) final put ffffa0b32fd94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787395103.623735:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b32fd94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787395103.623741:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00080000:2.0:1787395103.623742:0:12781:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffffa0b318dbcd40) has exports, disconnecting them 00000020:00080000:2.0:1787395103.623748:0:12781:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa0b3292cc000), last request at 1787394897 00000020:00000080:2.0:1787395103.623762:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7c71 00000020:00010000:2.0:1787395103.623767:0:12781:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa0b3292cc000: total 2 00000100:00080000:2.0:1787395103.623776:0:12781:0:(import.c:65:import_set_state_nolock()) ffffa0b3292c9800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787395103.623812:0:12781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b3292cc000): rc 0 00000020:00010000:0.0:1787395103.623813:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa0b3292cc000: total 2 00000020:00080000:2.0:1787395103.623823:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffffa0b318dbcd40) has no exports 00010000:00010000:0.0:1787395103.623862:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa0b3292cc000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787395103.623891:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342045600/0xedbabbe2e89a7d90 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7d89 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623919:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48e00/0xedbabbe2e89a7f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7f81 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623930:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa48800/0xedbabbe2e89a7f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7f73 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623942:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341011800/0xedbabbe2e89a7f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7f8f expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623953:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167600/0xedbabbe2e89a7fa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7f9d expref: 5 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623964:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55de00/0xedbabbe2e89a81bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a81b8 expref: 4 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623973:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b342167c00/0xedbabbe2e89a7fce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a7fc7 expref: 3 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623984:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55cc00/0xedbabbe2e89a81cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xedbabbe2e89a81c6 expref: 2 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395103.623995:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa0b3292cc000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787395103.624007:0:5790:0:(genops.c:906:class_export_put()) final put ffffa0b3292cc000/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 00010000:00010000:0.0:1787395103.624022:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395103.624024:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395103.624026:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395103.624748:0:5796:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa0b318d02600:5796] 1 exiting: rc = 0 00000100:00100000:2.0:1787395103.624766:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa0b30528ee00:5797] 2 exiting: rc = 0 00000020:00000080:1.0:1787395103.626604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3367ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787395103.627078:0:8:0:(genops.c:906:class_export_put()) final put ffffa0b3292cd800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787395103.627081:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3292cd800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787395103.627195:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787395103.628197:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3367ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787395103.628204:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b3292cc000/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 for MGS 00000020:00000080:1.0:1787395103.628247:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b3292c9800 for MGS 00000100:00100000:0.0:1787395103.628372:0:5795:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa0b30366d200:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1787395103.628591:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628600:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628606:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628612:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628618:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628623:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628629:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628634:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628641:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628652:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628657:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628665:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628728:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628737:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628743:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628748:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628754:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628760:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.628765:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631888:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631904:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631924:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631931:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631938:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631944:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631950:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631957:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631963:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631968:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631974:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631979:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631985:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631991:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.631997:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632003:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632009:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632014:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632020:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632025:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632031:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632037:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632043:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632049:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632055:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632061:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632068:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632073:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632079:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632086:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632092:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632098:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632105:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632111:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632117:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632123:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632128:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632141:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632146:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632151:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632156:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632161:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632166:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632177:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.632182:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787395103.633162:0:12781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787395103.633166:0:12781:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787395103.635938:0:12781:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b3397870c0 - data ffffa0b33fd17870/ffffa0b33fb42c00 00000020:01000000:1.0:1787395103.636039:0:12781:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b303951cc0 - data ffffa0b333f67798/ffffa0b329073400 00000020:00000080:1.0:1787395103.638094:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7c5c 00000020:00000080:1.0:1787395103.638105:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b318a8e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787395103.638126:0:12781:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b318a89000 from MGS, refs=2 00000020:01000004:1.0:1787395103.638129:0:12781:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b318a89000 2 00000020:01000004:1.0:1787395103.638133:0:12781:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0b318a89000 from MGS 00000020:00000080:1.0:1787395103.638162:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395103.638170:0:12781:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787395103.638173:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b318a8b000/MGS 00000020:00000080:1.0:1787395103.638176:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318a8b000/MGS for MGS 00000020:01000000:1.0:1787395103.638186:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1787395103.638236:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318a8e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787395103.638980:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787395103.638987:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787395103.638993:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787395103.639001:0:12781:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa0b32eded000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787395103.639009:0:12781:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffffa0b305ceb380) has exports, disconnecting them 00000020:00080000:1.0:1787395103.639014:0:12781:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffffa0b32eded000), last request at 1787394898 00000020:00000080:1.0:1787395103.639020:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7d27 00000020:00080000:1.0:1787395103.639029:0:12781:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b32eded000): rc 0 00000020:00000080:1.0:1787395103.639034:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b32eded000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787395103.639822:0:12781:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787395103.639857:0:12781:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787395103.639860:0:12781:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787395103.639865:0:12781:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787395103.640392:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b32eded000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787395103.641186:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33600b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787395103.641391:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395103.641401:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787395103.641407:0:12781:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b318a89000 1 00000020:00000080:2.0:1787395103.641557:0:37:0:(genops.c:906:class_export_put()) final put ffffa0b33600f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787395103.642230:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33600f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787395103.642239:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787395103.642384:0:12781:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7c4e 00000020:00000080:1.0:1787395103.642393:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b318a8c000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787395103.642555:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787395103.642562:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787395103.642567:0:12781:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787395103.642571:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffffa0b31810b380) has no exports 00000020:00000080:2.0:1787395103.644569:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b318a8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787395103.674302:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787395103.674345:0:12781:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787395103.674351:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b305122000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787395103.674355:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305122000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787395103.674365:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787395103.674540:0:12781:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0b318a8d000 00000020:01000000:0.0:1787395103.674564:0:12781:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787395103.674567:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787395103.674572:0:12781:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787395103.674576:0:12781:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffffa0b318dbb380) has no exports 00000100:00100000:1.0:1787395103.675179:0:11555:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa0b327e10e00:11555] 4 exiting: rc = 0 00000100:00100000:2.0:1787395103.675773:0:6624:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa0b33f8efc00:6624] 3 exiting: rc = 0 00000100:00100000:0.0:1787395103.676046:0:5803:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa0b327f5e400:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1787395103.676380:0:5802:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa0b327f5fa00:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1787395103.676448:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa0b3182da400:5804] 2 exiting: rc = 0 00000100:00100000:0.0:1787395103.676549:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676558:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676565:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676573:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676580:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676587:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676595:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676602:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676609:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676616:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676622:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676629:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676636:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676643:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676650:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676656:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676663:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676667:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676672:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676675:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676787:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676797:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676805:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676813:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676830:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676851:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.676862:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677198:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677203:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677209:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677215:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677219:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677224:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677229:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677235:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677240:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677245:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677250:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677256:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677261:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677266:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677271:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677277:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677282:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677287:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677292:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677297:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677351:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677358:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677363:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677369:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677376:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677380:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677385:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677391:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677397:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677403:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677408:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677414:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677430:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677435:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677442:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677448:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.677453:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.684978:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa0b327f5f000:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1787395103.685017:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa0b305c72400:5806] 1 exiting: rc = 0 00000100:00100000:2.0:1787395103.685093:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685103:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685109:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685115:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685120:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685126:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685131:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685136:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685142:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685147:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685152:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685157:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685163:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685168:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685173:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685178:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685182:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685198:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685203:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685208:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685212:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685217:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685221:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685226:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685231:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685236:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685240:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685245:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685259:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685265:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685270:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685275:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685280:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685284:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685289:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685293:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685298:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685303:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685333:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685338:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685342:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685347:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685352:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685357:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685362:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685367:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685372:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685376:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685382:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685387:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685394:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685398:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685409:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685414:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685419:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685425:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685431:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685438:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685444:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685450:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685456:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685462:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685466:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.685471:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.686078:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa0b308cdb000:5808] 1 exiting: rc = 0 00000100:00100000:0.0:1787395103.686201:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa0b302d0ba00:5807] 0 exiting: rc = 1 00000100:00100000:2.0:1787395103.686296:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686303:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686400:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686406:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686412:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686418:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686423:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686429:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686434:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686450:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686455:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686463:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686468:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686473:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686486:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686496:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686501:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686506:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686511:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686516:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686521:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686540:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686546:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686558:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686564:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686569:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686574:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686579:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686586:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686593:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686598:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686604:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686609:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686624:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686630:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686635:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686640:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686646:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686657:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686667:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686673:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686680:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686685:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686689:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686695:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686712:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686718:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686723:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686728:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686733:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686739:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686744:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686749:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686754:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686759:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686764:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686770:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686785:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686795:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686800:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686805:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686811:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686815:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.686826:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.699585:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa0b308cda000:5809] 0 exiting: rc = 1 00000100:00100000:1.0:1787395103.699899:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa0b3036faa00:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1787395103.700032:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700039:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700044:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700049:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700054:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700059:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700065:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700069:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700074:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700079:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700084:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700089:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700093:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700099:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700103:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700107:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700112:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700117:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700122:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700131:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700138:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700144:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700155:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700164:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700174:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700185:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700196:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700206:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700225:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700235:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700245:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700256:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700263:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700269:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700276:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700285:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700289:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700298:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700303:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700340:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700345:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700350:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700355:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700360:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700365:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700371:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700378:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700498:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700509:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700517:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700526:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700532:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700538:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700543:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700548:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700554:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700559:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700564:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700569:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700573:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700578:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700584:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700588:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787395103.700601:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395103.701576:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa0b3036fa200:5812] 1 exiting: rc = 0 00000100:00100000:0.0:1787395103.701803:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa0b3036fa800:5811] 0 exiting: rc = 1 00000100:00100000:3.0:1787395103.701939:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701946:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701951:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701956:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701961:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701966:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701971:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701975:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701981:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701987:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701992:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.701998:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702003:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702008:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702014:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702019:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702024:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702030:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702036:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702041:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702047:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702052:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702057:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702062:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702066:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702071:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702076:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702081:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702087:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702092:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702096:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702101:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702106:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702121:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702126:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702132:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702137:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702143:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702149:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702154:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702158:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702163:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702168:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702173:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702178:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702183:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702189:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702194:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702199:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702204:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702209:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702214:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702219:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702224:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702229:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702234:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702239:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702243:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702248:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702253:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702258:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702263:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702268:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.702274:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395103.703537:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa0b318114000:5814] 1 exiting: rc = 0 00000100:00100000:2.0:1787395103.703677:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa0b3036fba00:5813] 0 exiting: rc = 1 00000100:00100000:3.0:1787395103.704184:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704191:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704197:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704202:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704882:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704893:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704900:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704906:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704912:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704918:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704928:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704934:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704940:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704949:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704955:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704964:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704972:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704977:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704981:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704986:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704990:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704995:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.704999:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705003:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705007:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705011:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705016:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705020:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705024:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705029:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705033:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705038:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705042:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705046:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705051:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705055:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705060:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705065:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705069:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705081:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705085:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705090:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705094:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705099:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705103:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705108:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705113:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705118:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705123:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705127:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705132:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705136:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705140:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705145:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705150:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705154:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705158:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705163:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705167:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705171:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705175:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705179:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705184:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705189:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.705702:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa0b318b88e00:5817] 2 exiting: rc = 0 00000100:00100000:1.0:1787395103.705891:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa0b305c73a00:5815] 0 exiting: rc = 1 00000100:00100000:2.0:1787395103.707816:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa0b318c5b600:5816] 1 exiting: rc = 0 00000100:00100000:3.0:1787395103.707893:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707903:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707912:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707919:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707923:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707927:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707931:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707937:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707952:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707978:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707983:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707989:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.707995:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708001:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708009:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708016:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708024:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708034:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708040:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708047:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708053:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708059:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708069:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708075:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708082:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708087:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708093:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708098:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708104:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708110:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708116:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708122:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708143:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708150:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708155:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708162:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708167:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708174:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708179:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708185:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708191:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708196:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708201:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708206:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708219:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708224:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708230:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708235:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708240:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708246:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708251:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708256:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708261:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708267:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708272:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708278:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708296:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708845:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708853:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708861:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708868:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708875:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708880:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395103.708887:0:12781:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787395103.713792:0:12781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787395103.713805:0:12781:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787395103.713811:0:12781:0:(genops.c:906:class_export_put()) final put ffffa0b308c1f800/MDS_uuid 00000020:00000080:2.0:1787395103.713815:0:12781:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b308c1f800/MDS_uuid for MDS 00000020:01000000:2.0:1787395103.713821:0:12781:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787395103.713977:0:12781:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787395104.212248:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395105.237868:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395105.875469:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787395105.875494:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323440512:0@lo:400:kworker.0 00000100:00100000:1.0:1787395105.875506:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787395105.876440:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323440768:0@lo:400:kworker.0 00000400:00000100:3.0:1787395105.879378:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874219323440512 offset 0 length 224: 4 00000400:00000100:1.0:1787395105.879412:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323440640 offset 0 length 224: 4 00000400:00000100:0.0:1787395105.888588:0:3306:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323440768 offset 0 length 224: 4 00010000:00010000:0.0:1787395106.259011:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787395106.453044:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787395106.453053:0:7503:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787395106.453082:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787395106.453120:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fb4d000 for lustre-OST0001 00000020:01000004:0.0:1787395106.708977:0:12932:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787395106.725008:0:12932:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787395106.725372:0:12932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395106.725387:0:12932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395106.726350:0:12932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395106.726358:0:12932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395106.726379:0:12932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787395106.726385:0:12932:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1787395106.726596:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395106.726604:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395106.726612:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395106.726628:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395106.726643:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395106.726650:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395106.726657:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787395106.726660:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787395106.726662:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787395106.726697:0:5791:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395106.726704:0:5791:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787395106.726732:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395106.726739:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342166800/0xedbabbe2e89a7f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xedbabbe2e89a7f96 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395106.726753:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395106.726754:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395106.726756:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395106.726764:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787395106.726783:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323440896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395106.726854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395106.726913:0:11522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323440896 00000100:00100000:1.0:1787395106.726921:0:11522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323440896 00000100:00100000:1.0:1787395106.726957:0:11522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787395106.726971:0:11522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1874219323440896:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787395106.726977:0:11522:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787395106 with bad export cookie 17130210715896544369 00000100:00080000:0.0:1787395106.727071:0:12932:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787395106.727080:0:12932:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b327e75f80 x1874219323440640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395106.727100:0:12932:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787395106.727106:0:12932:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787395106.727118:0:12932:0:(import.c:65:import_set_state_nolock()) ffffa0b3393fa000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787395106.727128:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787395106.727138:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323441024:0@lo:39:umount.0 00000400:00000100:0.0:1787395106.727161:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323441024 offset 0 length 224: 4 00000100:00100000:0.0:1787395106.740830:0:11522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3304:x1874219323440896:12345-0@lo:103:ldlm_bl.0 Request processed in 13840us (13958us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787395106.740844:0:11522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787395106.745884:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.116@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787395106.745892:0:3304:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787395106.745897:0:3304:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787395106.764279:0:3304:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787395106.764286:0:3304:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787395106.764295:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b327e75880 x1874219323440512/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787395121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395106.764493:0:3304:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b327e75180 x1874219323440896/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787395122 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787395106.764503:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787395106.764506:0:3304:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787395106.764508:0:3304:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787395106.764512:0:3304:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787395106.764517:0:3304:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 169 00000100:00080000:2.0:1787395106.764526:0:3304:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa0b32058e000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787395106.764558:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b33677c000 x1874219323441152/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787395106.764614:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3304:1874219323440896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395106.764764:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323441152:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1787395106.764823:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874219323441152 offset 0 length 520: 4 00000100:00100000:0.0:1787395106.765490:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3303:1874219323440512:0@lo:400:kworker.0 00010000:00010000:1.0:1787395107.284645:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787395108.056841:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787395108.056850:0:6626:0:(genops.c:906:class_export_put()) final put ffffa0b33fa8c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787395108.056937:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fa8c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787395108.056987:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b33fa89800 for lustre-OST0000 00010000:00010000:0.0:1787395108.306863:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395109.330693:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395110.354805:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787395110.994514:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787395110.994525:0:12633:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787395110.997610:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323441280:0@lo:400:kworker.0 00000400:00000100:2.0:1787395110.997678:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323441280 offset 0 length 224: 4 00010000:00010000:0.0:1787395111.378642:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787395112.019347:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787395112.019357:0:12633:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787395112.019493:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323441408:0@lo:400:kworker.0 00000400:00000100:3.0:1787395112.019562:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323441408 offset 0 length 224: 4 00010000:00010000:1.0:1787395112.402923:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395113.427225:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395114.453402:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395115.483816:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395116.114539:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395106/real 1787395106] req@ffffa0b33677c000 x1874219323441152/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787395116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395116.114586:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b33677c000 x1874219323441152/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787395116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395116.114628:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395106/real 1787395106] req@ffffa0b32fa51f80 x1874219323441024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787395116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395116.114643:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b32fa51f80 x1874219323441024/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787395116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787395116.114666:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787395116.114745:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1787395116.114759:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323441152:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1787395116.114774:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b3393fa000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787395116.114796:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323441024:0@lo:39:umount.0 00000100:00080000:0.0:1787395116.115063:0:12932:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787395116.115070:0:12932:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787395116.115075:0:12932:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787395116.119617:0:12932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119640:0:12932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119649:0:12932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119657:0:12932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119733:0:12932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787395116.119741:0:12932:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119747:0:12932:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119784:0:12932:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395116.119790:0:12932:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787395116.119849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787395116.119856:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787395116.119860:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787395116.119868:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 378 00000100:00080000:2.0:1787395116.119874:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787395116.119880:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa0b32058e000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787395116.119917:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b33677c000 x1874219323441536/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787395116.122053:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787395116.122093:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323441664:0@lo:400:kworker.0 00000400:00000100:3.0:1787395116.122164:0:3305:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323441664 offset 0 length 224: 4 00000100:00100000:3.0:1787395116.122262:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323441536:0@lo:250:kworker.0 00000400:00000100:3.0:1787395116.122284:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874219323441536 offset 0 length 520: 4 00010000:00010000:1.0:1787395116.122714:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787395116.122725:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122738:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ca00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395116.122743:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122773:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395116.122781:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395116.122810:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787395116.122813:0:7492:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1787395116.122830:0:7492:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:1.0:1787395116.122834:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122840:0:7492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55ca00/0xedbabbe2e89a7f9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7fa4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122855:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395116.122859:0:7492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122864:0:7492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:1.0:1787395116.122867:0:7492:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122874:0:7492:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787395116.122880:0:7492:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395116.122885:0:7492:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787395116.122887:0:7492:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787395116.122891:0:7492:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:1.0:1787395116.122894:0:7492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395116.122910:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395116.122912:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395116.122914:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395116.123332:0:12932:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787395116.123342:0:12932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d200/0xedbabbe2e89a81c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a81cd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395116.123355:0:12932:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787395116.123360:0:12932:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787395116.123364:0:12932:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787395116.123395:0:12932:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787395116.123400:0:12932:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787395116.123408:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787395116.123416:0:12932:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787395116.123420:0:12932:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa0b305ce8000) has no exports 00000020:00080000:0.0:1787395116.123452:0:12932:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa0b305ce8000) has no exports 00010000:00010000:3.0:1787395116.127059:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787395116.127891:0:12932:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b3083689c0 - data ffffa0b33fd260d8/ffffa0b33f568000 00000020:01000000:1.0:1787395116.128025:0:12932:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b3203f40c0 - data ffffa0b310c6e000/ffffa0b33fa95400 00100000:10000000:3.0:1787395116.161785:0:12932:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787395116.199984:0:12932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7dac 00000020:00000080:1.0:1787395116.199993:0:12932:0:(genops.c:906:class_export_put()) final put ffffa0b305de8000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787395116.200014:0:12932:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b305de9800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787395116.200017:0:12932:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b305de9800 2 00000020:01000004:1.0:1787395116.200020:0:12932:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0b305de9800 from lustre-OST0000 00000020:00000080:1.0:1787395116.200045:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395116.200054:0:12932:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787395116.200057:0:12932:0:(genops.c:906:class_export_put()) final put ffffa0b329233800/lustre-OST0000_UUID 00000020:00000080:1.0:1787395116.200060:0:12932:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b329233800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787395116.200066:0:12932:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787395116.200109:0:12932:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787395116.200113:0:12932:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787395116.200117:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787395116.200121:0:12932:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787395116.200126:0:12932:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa0b305dd1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787395116.200132:0:12932:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffffa0b33f938000) has exports, disconnecting them 00000020:00080000:1.0:1787395116.200136:0:12932:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffffa0b305dd1800), last request at 1787394914 00000020:00000080:1.0:1787395116.200139:0:12932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7dd6 00000020:00080000:1.0:1787395116.200151:0:12932:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b305dd1800): rc 0 00000020:00000080:1.0:1787395116.200156:0:12932:0:(genops.c:906:class_export_put()) final put ffffa0b305dd1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787395116.200835:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305de8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787395116.200852:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305dd1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787395116.205434:0:12932:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787395116.205443:0:12932:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787395116.205447:0:12932:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787395116.205467:0:12932:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787395116.205635:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395116.205644:0:12932:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787395116.205652:0:12932:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b305de9800 1 00000020:00000080:1.0:1787395116.205659:0:12932:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7d58 00000020:00000080:1.0:1787395116.205668:0:12932:0:(genops.c:906:class_export_put()) final put ffffa0b305dd4800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1787395116.205673:0:12932:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1787395116.205678:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787395116.205682:0:12932:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787395116.205686:0:12932:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffffa0b305ce99c0) has no exports 00000020:00000080:2.0:1787395116.206028:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b3393fa000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787395116.206036:0:8:0:(genops.c:906:class_export_put()) final put ffffa0b33f636000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787395116.206039:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33f636000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787395116.206047:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787395116.206113:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305dd4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787395116.226481:0:12932:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395116.226498:0:12932:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787395116.226503:0:12932:0:(genops.c:906:class_export_put()) final put ffffa0b305def000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787395116.226509:0:12932:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305def000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787395116.226518:0:12932:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787395116.226661:0:12932:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0b305dec000 00000020:02000400:1.0:1787395116.226701:0:12932:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787395116.498971:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395117.529127:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395118.547743:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787395119.275652:0:13084:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787395119.291448:0:13084:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787395119.291531:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395119.291547:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395119.291554:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395119.291560:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395119.291601:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787395119.291607:0:13084:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787395119.291634:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787395119.291645:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b327e74380 x1874219323440768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395121 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395119.291666:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b327e76680 x1874219323441280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395119.291678:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b32fa52d80 x1874219323441408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395128 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395119.291691:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b33677df80 x1874219323441664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395132 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395119.291698:0:13084:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787395119.291703:0:13084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787395119.291740:0:13084:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787395119.291797:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323441664:0@lo:400:kworker.0 00000100:00100000:1.0:1787395119.291806:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1874219323441408:0@lo:400:kworker.0 00000100:00100000:1.0:1787395119.291847:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323441792:0@lo:39:umount.0 00000400:00000100:1.0:1787395119.291892:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874219323441792 offset 0 length 224: 4 00010000:00010000:0.0:1787395119.291996:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395119.292004:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395119.292011:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b342166c00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395119.292014:0:5791:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395119.292021:0:5791:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395119.292035:0:5791:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395119.292040:0:5791:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787395119.292042:0:5791:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787395119.292044:0:5791:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787395119.292071:0:5791:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:0.0:1787395119.292075:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395119.292081:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342166c00/0xedbabbe2e89a7f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7f7a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395119.292093:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395119.292094:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395119.292096:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395119.292662:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323440768:0@lo:400:kworker.0 00000100:00100000:2.0:1787395119.292695:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323441280:0@lo:400:kworker.0 00010000:00010000:1.0:1787395119.570838:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395120.594457:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787395121.235578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787395121.235588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787395121.618811:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395122.647029:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395123.666511:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395124.690885:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395125.715302:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787395126.354412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787395126.354422:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787395126.739705:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395127.763614:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395128.786768:0:7492:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395129.492183:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395119/real 1787395119] req@ffffa0b327e75880 x1874219323441792/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787395129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395129.492216:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b327e75880 x1874219323441792/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787395129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787395129.492235:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787395129.492256:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323441792:0@lo:39:umount.0 00000100:00080000:3.0:1787395129.492348:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787395129.492353:0:13084:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787395129.492358:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787395129.494410:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494440:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494448:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494466:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494560:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395129.494567:0:13084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494574:0:13084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494580:0:13084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.494587:0:13084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499245:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787395129.499260:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499271:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395129.499275:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499286:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395129.499326:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395129.499332:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787395129.499346:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787395129.499360:0:5790:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:0.0:1787395129.499364:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499371:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b341011000/0xedbabbe2e89a7f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7f88 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499389:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395129.499393:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499399:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395129.499402:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499408:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395129.499414:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395129.499419:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787395129.499421:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787395129.499424:0:5790:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:0.0:1787395129.499432:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395129.499438:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395129.499440:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395129.499442:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395129.502834:0:13084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787395129.502858:0:13084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b341011e00/0xedbabbe2e89a81b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a81bf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395129.502884:0:13084:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787395129.502893:0:13084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1787395129.502896:0:13084:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787395129.502941:0:13084:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787395129.502945:0:13084:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787395129.502952:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787395129.502967:0:13084:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787395129.502971:0:13084:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffffa0b3411d3380) has no exports 00000020:00080000:3.0:1787395129.502996:0:13084:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffffa0b3411d3380) has no exports 00010000:00010000:0.0:1787395129.512377:0:5791:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787395129.512867:0:13084:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b308368540 - data ffffa0b33fd26bd0/ffffa0b33f569c00 00000020:01000000:3.0:1787395129.513008:0:13084:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa0b339787a20 - data ffffa0b33fd20af8/ffffa0b33fb43c00 00100000:10000000:3.0:1787395129.524877:0:13084:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787395129.576384:0:13084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7e77 00000020:00000080:3.0:1787395129.576392:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b33fb49000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787395129.576408:0:13084:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b33f645800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787395129.576411:0:13084:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b33f645800 2 00000020:01000004:3.0:1787395129.576414:0:13084:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa0b33f645800 from lustre-OST0001 00000020:00000080:3.0:1787395129.576446:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787395129.576456:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787395129.576459:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4a000/lustre-OST0001_UUID 00000020:00000080:3.0:1787395129.576461:0:13084:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787395129.576467:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787395129.576569:0:13084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8581b891-0741-4f4a-b0af-8eaaf7ff17d5->MGS 00010000:00010000:3.0:1787395129.576584:0:13084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787395129.576727:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb49000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:00010000:3.0:1787395129.576775:0:13084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395129.576782:0:13084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787395129.576785:0:13084:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787395129.576788:0:13084:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787395129.576803:0:13084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:3.0:1787395129.576807:0:13084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b30148ea00/0xedbabbe2e89a7d89 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7d90 expref: -99 pid: 6597 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395129.576835:0:13084:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395129.576842:0:13084:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395129.576847:0:13084:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787395129.576849:0:13084:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787395129.576851:0:13084:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787395129.576861:0:13084:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa0b32058e000 00010000:00010000:3.0:1787395129.576864:0:13084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b342167000/0xedbabbe2e89a7fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xedbabbe2e89a7fce expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787395129.576883:0:13084:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787395129.576887:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787395129.576889:0:13084:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787395129.576891:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787395129.576894:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787395129.576904:0:13084:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa0b33677c000 x1874219323441536/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787395131 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787395129.577062:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787395129.577066:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787395129.586237:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8581b891-0741-4f4a-b0af-8eaaf7ff17d5:3302:1874219323441536:0@lo:250:kworker.0 10000000:01000000:0.0:1787395129.589417:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787395129.589437:0:13084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7c6a 00000020:00000080:0.0:1787395129.589446:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b308c18800/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 00000020:01000000:0.0:1787395129.589467:0:13084:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.116@tcp (flags='') 00000020:00000080:0.0:1787395129.589488:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b308c18800/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 for MGC192.168.203.116@tcp 00000020:00000080:0.0:1787395129.589523:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787395129.589537:0:13084:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.116@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787395129.589541:0:13084:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffffa0b3181099c0) has no exports 10000000:01000000:2.0:1787395129.595961:0:5799:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787395129.596134:0:13084:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.116@tcp: client import never connected 00000100:00080000:0.0:1787395129.596139:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787395129.596143:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787395129.596146:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787395129.596149:0:13084:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787395129.596194:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787395129.596203:0:13084:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.116@tcp (uuid 8581b891-0741-4f4a-b0af-8eaaf7ff17d5) 00000020:01000000:0.0:1787395129.596209:0:13084:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787395129.596213:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787395129.596218:0:13084:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787395129.596225:0:13084:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa0b33fb48800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787395129.596231:0:13084:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffffa0b3411d19c0) has exports, disconnecting them 00000020:00080000:0.0:1787395129.596235:0:13084:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffffa0b33fb48800), last request at 1787394930 00000020:00000080:0.0:1787395129.596240:0:13084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7ea1 00000020:00080000:0.0:1787395129.596255:0:13084:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa0b33fb48800): rc 0 00000020:00000080:0.0:1787395129.596264:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b33fb48800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787395129.596989:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb48800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787395129.597911:0:12633:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b32058e000 for MGC192.168.203.116@tcp 00000020:00000080:3.0:1787395129.597921:0:12633:0:(genops.c:906:class_export_put()) final put ffffa0b32058d000/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 00000020:00000080:3.0:1787395129.597924:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b32058d000/8581b891-0741-4f4a-b0af-8eaaf7ff17d5 for MGC192.168.203.116@tcp 00000020:01000000:3.0:1787395129.597930:0:12633:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.116@tcp (8581b891-0741-4f4a-b0af-8eaaf7ff17d5) 00010000:01000000:1.0:1787395129.599281:0:13084:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787395129.599288:0:13084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787395129.599292:0:13084:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787395129.599298:0:13084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787395129.599369:0:7492:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787395129.599514:0:12633:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa0b302d9c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787395129.602074:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787395129.602689:0:5791:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787395129.602855:0:5786:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa0b318198e00:5786] 1 exiting: rc = 0 00000100:00100000:1.0:1787395129.602926:0:5785:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa0b30359f000:5785] 0 exiting: rc = 1 00000100:00100000:3.0:1787395129.603060:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787395129.603467:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa0b31876a400:5788] 1 exiting: rc = 0 00000100:00100000:1.0:1787395129.603634:0:5787:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa0b31876a600:5787] 0 exiting: rc = 1 00000100:00100000:1.0:1787395129.608016:0:11522:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa0b327ea0400:11522] 3 exiting: rc = 0 00000100:00100000:1.0:1787395129.609476:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa0b31876ba00:5789] 2 exiting: rc = 0 00000100:00100000:3.0:1787395129.609624:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609633:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609639:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609644:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609649:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609667:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609674:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609679:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609684:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609689:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609694:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609700:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609705:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609712:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609716:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609722:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609727:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609732:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609737:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609742:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609746:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609751:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609756:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609761:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609766:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609771:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609777:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609782:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609787:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609793:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609798:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609802:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609807:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609812:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609817:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609839:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609845:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609850:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609855:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609861:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609866:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609870:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609875:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609880:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609886:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609891:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609896:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609900:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609905:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609910:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609916:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609920:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609926:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609931:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609936:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609941:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609947:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609964:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609970:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609976:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609984:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609989:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609994:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.609999:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787395129.611255:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787395129.611265:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787395129.611271:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b33fb4e800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787395129.611275:0:13084:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33fb4e800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787395129.611281:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787395129.611375:0:13084:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b33f645800 1 00000020:00000080:3.0:1787395129.611381:0:13084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xedbabbe2e89a7e46 00000020:00000080:3.0:1787395129.611387:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b327f7f800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787395129.611399:0:13084:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787395129.611410:0:12633:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b327f7f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787395129.611420:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787395129.611425:0:13084:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787395129.611428:0:13084:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffffa0b318db99c0) has no exports 00000020:00000080:1.0:1787395129.654487:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395129.654510:0:13084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787395129.654516:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b33f640000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787395129.655243:0:13084:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b33f640000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787395129.655254:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787395129.655459:0:13084:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffffa0b33f643800 00000020:01000000:1.0:1787395129.655480:0:13084:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787395129.655484:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787395129.655489:0:13084:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787395129.655502:0:13084:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffffa0b318108000) has no exports 00000020:00000080:1.0:1787395129.655540:0:13084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787395129.655547:0:13084:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787395129.655550:0:13084:0:(genops.c:906:class_export_put()) final put ffffa0b305dd7800/OSS_uuid 00000020:00000080:1.0:1787395129.655552:0:13084:0:(genops.c:865:class_export_destroy()) destroying export ffffa0b305dd7800/OSS_uuid for OSS 00000020:01000000:1.0:1787395129.655555:0:13084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787395129.655637:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa0b3082a8400:6601] 1 exiting: rc = 0 00000100:00100000:1.0:1787395129.657328:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa0b318c91400:6599] 0 exiting: rc = 1 00000100:00080000:1.0:1787395129.657388:0:5798:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787395129.658084:0:8490:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa0b33913d000:8490] 3 exiting: rc = 0 00000100:00100000:2.0:1787395129.660710:0:12333:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffffa0b201dc0200:12333] 4 exiting: rc = 0 00000100:00100000:3.0:1787395129.670485:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa0b341148600:6602] 2 exiting: rc = 0 00000100:00100000:1.0:1787395129.670889:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670899:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670905:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670911:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670916:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670920:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670926:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670931:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670936:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670941:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.670947:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672809:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672820:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672825:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672831:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672836:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672840:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672845:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672849:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672866:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672871:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672875:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672880:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672884:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672889:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672893:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672898:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672903:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672908:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672913:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672918:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672923:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672929:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672934:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672939:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672944:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672948:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672952:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672966:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672972:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672976:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672980:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672985:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672990:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672994:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.672999:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673003:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673007:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673013:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673018:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673022:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673027:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673032:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673037:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673049:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673054:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673059:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673063:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673068:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673074:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673079:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673083:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673088:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.673093:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676360:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa0b341121e00:6603] 0 exiting: rc = 1 00000100:00100000:1.0:1787395129.676445:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa0b318114400:6604] 1 exiting: rc = 0 00000100:00100000:1.0:1787395129.676498:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676507:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676513:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676519:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676524:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676605:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676612:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676617:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676623:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676628:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676633:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676638:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676644:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676649:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676654:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676672:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676677:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676683:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676687:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676692:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676697:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676703:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676708:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676728:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676733:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676738:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676743:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676748:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676754:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676758:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676764:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676768:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676774:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676778:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676783:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676788:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676792:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676796:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676801:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676806:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676811:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676816:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676821:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676826:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676831:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676837:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676842:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676847:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676852:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676858:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676863:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676868:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676872:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676877:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676882:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676886:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676891:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676896:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676908:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676913:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676917:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676922:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676927:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787395129.676933:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.688022:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa0b32fd86a00:6607] 2 exiting: rc = 0 00000100:00100000:1.0:1787395129.692410:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa0b318c90c00:6605] 0 exiting: rc = 1 00000100:00100000:2.0:1787395129.695420:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa0b318c91600:6606] 1 exiting: rc = 0 00000100:00100000:3.0:1787395129.695764:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695774:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695781:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695787:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695793:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695798:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695804:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695811:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695817:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695824:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695829:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695835:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695841:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695847:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695853:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695859:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695865:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695871:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695891:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695898:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695904:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695910:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695916:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695922:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695939:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695945:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695951:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695969:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695974:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695980:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695986:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695991:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.695996:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696002:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696007:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696012:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696017:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696022:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696028:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696033:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696039:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696045:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696064:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696071:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696076:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696082:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696087:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696092:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696098:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696103:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696108:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696114:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696120:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696125:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696130:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696136:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696152:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696158:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696163:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696176:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696181:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696187:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696193:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.696198:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.715418:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa0b320148400:6609] 1 exiting: rc = 0 00000100:00100000:3.0:1787395129.717465:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa0b320148600:6608] 0 exiting: rc = 1 00000100:00100000:3.0:1787395129.717584:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717600:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717605:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717610:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717616:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717620:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717626:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717631:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717637:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717641:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717646:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717651:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717665:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717670:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717675:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717680:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717685:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717689:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717694:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717699:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717704:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717709:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717714:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717719:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717724:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717728:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717734:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717739:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717757:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717761:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717766:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717773:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717778:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717782:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717787:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717793:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717797:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717802:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717808:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717813:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717818:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717823:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717827:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717832:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717836:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717840:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717845:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717849:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717854:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717858:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717863:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717867:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717871:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717876:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717893:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717899:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717903:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717907:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717912:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717917:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717921:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717927:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717932:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.717944:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.718624:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa0b34111de00:6610] 0 exiting: rc = 1 00000100:00100000:1.0:1787395129.720046:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa0b337ecdc00:6611] 1 exiting: rc = 0 00000100:00100000:3.0:1787395129.720257:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720265:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720271:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720278:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720297:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720334:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720341:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720348:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720354:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720360:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720366:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720372:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720378:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720385:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720390:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720396:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720416:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720426:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720431:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720438:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720443:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720449:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720455:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720461:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720466:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720471:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720477:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.720482:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721398:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721407:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721412:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721419:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721425:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721443:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721448:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721453:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721459:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721464:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721469:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721474:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721715:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721725:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721730:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721736:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721742:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721747:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721752:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721758:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721764:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721769:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721776:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721782:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721801:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721808:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721813:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721819:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721825:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721830:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721835:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721841:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721847:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721853:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721860:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787395129.721866:0:13084:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787395129.748949:0:13084:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787395148.537430:0:13701:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787395155.871828:0:14113:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787395155.871833:0:14113:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787395155.871956:0:14113:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0b336008000 00000020:01000004:2.0:1787395155.871971:0:14113:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787395155.871978:0:14113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787395155.871991:0:14113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa0b318dbb380) 00000020:00000080:2.0:1787395155.872005:0:14113:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787395155.884803:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787395155.887172:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787395155.887655:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787395155.887707:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 581: rc = 0 00100000:10000000:2.0:1787395155.887784:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 581: rc = 0 00100000:10000000:2.0:1787395155.887856:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 581: rc = 0 00100000:10000000:2.0:1787395155.887998:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 581: rc = 0 00100000:10000000:2.0:1787395155.888078:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 581: rc = 0 00100000:10000000:2.0:1787395155.888200:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 581: rc = 0 00100000:10000000:2.0:1787395155.888542:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 583: rc = 0 00100000:10000000:2.0:1787395155.889902:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:2.0:1787395155.890079:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:2.0:1787395155.890745:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.891063:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.891412:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 724: rc = 0 00100000:10000000:2.0:1787395155.891676:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 724: rc = 0 00100000:10000000:2.0:1787395155.892004:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 724: rc = 0 00100000:10000000:2.0:1787395155.892254:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.892603:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.892856:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 724: rc = 0 00100000:10000000:2.0:1787395155.893172:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 724: rc = 0 00100000:10000000:2.0:1787395155.893638:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.893875:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 724: rc = 0 00100000:10000000:2.0:1787395155.894197:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 724: rc = 0 00100000:10000000:0.0:1787395155.894833:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 776: rc = 0 00100000:10000000:0.0:1787395155.895172:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 776: rc = 0 00100000:10000000:0.0:1787395155.895515:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 776: rc = 0 00100000:10000000:0.0:1787395155.895739:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 776: rc = 0 00100000:10000000:0.0:1787395155.896034:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 776: rc = 0 00100000:10000000:0.0:1787395155.896275:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 776: rc = 0 00100000:10000000:0.0:1787395155.896604:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 776: rc = 0 00100000:10000000:0.0:1787395155.896820:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 776: rc = 0 00100000:10000000:0.0:1787395155.897126:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 776: rc = 0 00100000:10000000:0.0:1787395155.897467:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 776: rc = 0 00100000:10000000:0.0:1787395155.897712:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 776: rc = 0 00100000:10000000:0.0:1787395155.898001:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 776: rc = 0 00100000:10000000:0.0:1787395155.898220:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 776: rc = 0 00100000:10000000:0.0:1787395155.898844:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 776: rc = 0 00100000:10000000:0.0:1787395155.899151:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 776: rc = 0 00100000:10000000:0.0:1787395155.899401:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 776: rc = 0 00100000:10000000:0.0:1787395155.899688:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 776: rc = 0 00100000:10000000:0.0:1787395155.899997:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 776: rc = 0 00100000:10000000:0.0:1787395155.900210:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 776: rc = 0 00100000:10000000:0.0:1787395155.900468:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 776: rc = 0 00100000:10000000:0.0:1787395155.900705:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 776: rc = 0 00100000:10000000:0.0:1787395155.900964:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 776: rc = 0 00100000:10000000:0.0:1787395155.901403:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 776: rc = 0 00100000:10000000:0.0:1787395155.901641:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 776: rc = 0 00100000:10000000:0.0:1787395155.901872:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 776: rc = 0 00100000:10000000:0.0:1787395155.902277:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 776: rc = 0 00100000:10000000:0.0:1787395155.902590:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 776: rc = 0 00100000:10000000:0.0:1787395155.902809:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 776: rc = 0 00100000:10000000:0.0:1787395155.903590:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 776: rc = 0 00100000:10000000:0.0:1787395155.903824:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 776: rc = 0 00100000:10000000:0.0:1787395155.904140:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 776: rc = 0 00100000:10000000:0.0:1787395155.904512:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 776: rc = 0 00100000:10000000:0.0:1787395155.904856:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 263: rc = 0 00100000:10000000:0.0:1787395155.905470:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787395155.905660:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:0.0:1787395155.905832:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787395155.905893:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:0.0:1787395155.906141:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787395155.906205:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:0.0:1787395155.906661:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787395155.906727:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 721: rc = 0 00100000:10000000:0.0:1787395155.906982:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787395155.907052:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 721: rc = 0 00100000:10000000:0.0:1787395155.907231:0:14113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787395155.907294:0:14113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 721: rc = 0 00000020:00000080:0.0:1787395155.907627:0:14113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787395155.907635:0:14113:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787395155.907644:0:14113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a8f6b 00000020:01000004:0.0:1787395155.907651:0:14113:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787395155.907656:0:14113:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787395155.907660:0:14113:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b336008000 from MGS 00000020:01000004:0.0:1787395155.907668:0:14113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787395155.907677:0:14113:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa0b33f93cd40) 00000020:00000080:0.0:1787395155.907687:0:14113:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787395155.907737:0:14113:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b336008000 from MGS, refs=2 00080000:01000000:0.0:1787395155.907742:0:14113:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787395155.907747:0:14113:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a8f79 00000100:00100000:0.0:1787395155.907831:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787395155.908015:0:14113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787395155.908021:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787395155.908535:0:14113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787395155.908542:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787395155.909176:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787395155.909302:0:14113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787395155.909404:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787395155.909877:0:14113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787395155.909884:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787395155.910373:0:14113:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787395155.910380:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787395155.911190:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395155.911193:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395155.911195:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395155.911574:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395155.911576:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395155.911578:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395155.912053:0:14113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787395155.916181:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787395155.925233:0:14113:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787395155.925250:0:14113:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787395155.925253:0:14113:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787395155.926675:0:14122:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787395155.926792:0:14113:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787395155.926886:0:14113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787395155.927328:0:14113:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787395155.927639:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.927760:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787395155.927766:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787395155.929690:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787395155.929699:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787395155.930621:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787395155.930629:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787395155.934029:0:14127:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787395155.934083:0:14113:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787395155.934105:0:14113:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.116@tcp' 00000020:01000004:0.0:1787395155.934106:0:14113:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787395155.934138:0:14113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.116@tcp (typ=mgc) 00000020:00000080:0.0:1787395155.934150:0:14113:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.116@tcp (ffffa0b33f93b380) 00000020:00000080:0.0:1787395155.934166:0:14113:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787395155.934232:0:14113:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b3292f7000@MGC192.168.203.116@tcp: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787395155.935189:0:14113:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.116@tcp-0 is initialized 00000040:01000000:1.0:1787395155.935198:0:14113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787395155.935670:0:14128:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787395155.935743:0:14113:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.116@tcp (uuid dd69c846-0fd6-4b2d-8c27-adaad01fec71) 00000020:00000080:3.0:1787395155.935760:0:14113:0:(genops.c:1406:class_connect()) connect: client dd69c846-0fd6-4b2d-8c27-adaad01fec71, cookie 0xedbabbe2e89a8f87 00000100:00080000:3.0:1787395155.935776:0:14113:0:(import.c:510:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787395155.935782:0:14113:0:(import.c:624:import_select_connection()) MGC192.168.203.116@tcp: import ffffa0b3292f7000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1787395155.935813:0:14113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b336768380 x1874219323441920/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787395155.935838:0:14113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd69c846-0fd6-4b2d-8c27-adaad01fec71->MGS 00000020:01000004:3.0:1787395155.935859:0:14113:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787395155.935863:0:14113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787395155.935876:0:14113:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa0b3411d19c0) 00000020:00000080:3.0:1787395155.935885:0:14113:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787395155.936151:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3302:1874219323441920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787395155.936215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395155.936348:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323441920 00000100:00100000:0.0:1787395155.936355:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323441920 00000100:00100000:0.0:1787395155.936384:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395155.936391:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1874219323441920:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787395155.936413:0:14124:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from dd69c846-0fd6-4b2d-8c27-adaad01fec71@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:0.0:1787395155.936431:0:14124:0:(genops.c:1406:class_connect()) connect: client dd69c846-0fd6-4b2d-8c27-adaad01fec71, cookie 0xedbabbe2e89a8f95 00000100:00080000:0.0:1787395155.936568:0:14124:0:(import.c:65:import_set_state_nolock()) ffffa0b3292f4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787395155.936622:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+5:3302:x1874219323441920:12345-0@lo:250:mount.lustre.0 Request processed in 230us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395155.936629:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395155.936799:0:3302:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787395155.936807:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1787395155.936815:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787395155.936819:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787395155.936822:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b3292f7000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787395155.936824:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787395155.936838:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787395155.936843:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3302:1874219323441920:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787395155.947101:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787395155.947370:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787395155.947376:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787395155.955049:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787395155.955059:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787395155.955809:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787395155.955816:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787395155.956782:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.956940:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787395155.956945:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787395155.959735:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787395155.959746:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787395155.985148:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.985574:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787395155.985581:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787395155.986491:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787395155.986498:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787395155.988636:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.988784:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787395155.988791:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787395155.989425:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787395155.989432:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787395155.989944:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.990052:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787395155.990057:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787395155.993796:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787395155.993811:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787395155.994539:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787395155.994686:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787395155.994690:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787395155.995113:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787395155.995119:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787395156.008142:0:14113:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787395156.008459:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787395156.008467:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787395156.011167:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787395156.011181:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787395156.012174:0:14113:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787395156.012183:0:14113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787395156.013077:0:14113:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787395156.013099:0:14113:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787395156.013106:0:14113:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787395156.013228:0:14113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787395156.013403:0:14113:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787395156.013407:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787395156.013409:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.013410:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.013411:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.013412:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.013424:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.013425:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.013427:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.013428:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.013430:0:14113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787395156.013437:0:14113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787395156.013439:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787395156.013440:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.013553:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.013555:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.013555:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.013557:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.013558:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.013559:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.013560:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.013560:0:14113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787395156.013587:0:14113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787395156.013607:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787395156.013673:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.013752:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60480 going to sleep for 11 seconds 00000100:00100000:0.0:1787395156.013794:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442048 00000100:00100000:0.0:1787395156.013802:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442048 00000100:00100000:0.0:1787395156.013895:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787395156.013905:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+5:14113:x1874219323442048:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787395156.013950:0:14126:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787395156.013956:0:14126:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787395156.013960:0:14126:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787395156.014465:0:14147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787395156.015108:0:14126:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787395156.017051:0:14148:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787395156.017058:0:14148:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787395156.017060:0:14148:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787395156.017093:0:14148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787395156.017662:0:14126:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787395156.017673:0:14126:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787395156.028041:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+5:14113:x1874219323442048:12345-0@lo:253:mount.lustre.0 Request processed in 14128us (14358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.028062:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787395156.028161:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442048:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787395156.028176:0:14113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787395156.028179:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787395156.028180:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.028182:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.028183:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.028184:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.028185:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.028186:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.028188:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.028189:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.028191:0:14113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787395156.028213:0:14113:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b336008000 from lustre-MDT0000 10000000:01000000:1.0:1787395156.028244:0:14113:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787395156.028247:0:14113:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787395156.028251:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa0b33f93b380 10000000:01000000:1.0:1787395156.028255:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787395156.028263:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa0b33f93b380 from 1 10000000:01000000:1.0:1787395156.028266:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787395156.028343:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.028369:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.028549:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.028571:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787395156.028608:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.028646:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.028748:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442176 00000100:00100000:3.0:1787395156.028756:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442176 00000100:00100000:3.0:1787395156.028795:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787395156.028804:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+5:14113:x1874219323442176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395156.028816:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395156.028831:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a8fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a8f9c expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.028854:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a8fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a8f9c expref: 6 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.028877:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55da00/0xedbabbe2e89a8fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8f9c expref: 6 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.028886:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55da00, rc 0) 00000100:00100000:3.0:1787395156.028922:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+6:14113:x1874219323442176:12345-0@lo:101:mount.lustre.0 Request processed in 119us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.028927:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787395156.029034:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395156.029047:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.029056:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.029104:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395156.029129:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.029153:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.029196:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442304 00000100:00100000:3.0:1787395156.029200:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442304 00000100:00100000:3.0:1787395156.029229:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395156.029235:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+6:14113:x1874219323442304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395156.029673:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+6:14113:x1874219323442304:12345-0@lo:501:mount.lustre.0 Request processed in 437us (542us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787395156.029680:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787395156.029743:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442304:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787395156.029769:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787395156.029829:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.029838:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395156.029856:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b336008000 10000000:01000000:1.0:1787395156.029861:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787395156.029865:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa0b336008000 10000000:01000000:1.0:1787395156.029868:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787395156.029871:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa0b336008000 from 1 10000000:01000000:1.0:1787395156.029873:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787395156.029892:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.029900:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.029907:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.029919:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787395156.029945:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.029975:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.030076:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442432 00000100:00100000:3.0:1787395156.030080:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442432 00000100:00100000:3.0:1787395156.030113:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395156.030120:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+6:14113:x1874219323442432:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395156.030128:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395156.030139:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a8fb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a8faa expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.030154:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a8fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a8faa expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.030162:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c600/0xedbabbe2e89a8fb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8faa expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.030181:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c600, rc 0) 00000100:00100000:3.0:1787395156.030223:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+7:14113:x1874219323442432:12345-0@lo:101:mount.lustre.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.030229:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787395156.030290:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442432:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395156.030301:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fb1 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.030336:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a8fb1 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395156.030349:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787395156.031024:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fb1 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.031035:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339128600/0xedbabbe2e89a8faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fb1 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395156.031043:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787395156.031049:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787395156.031054:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa0b336008000 10000000:01000000:2.0:1787395156.031058:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787395156.031062:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787395156.031064:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787395156.031096:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.031103:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.031110:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395156.031125:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787395156.031178:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395156.031212:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302dde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.031268:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442560 00000100:00100000:3.0:1787395156.031273:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442560 00000100:00100000:3.0:1787395156.031351:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787395156.031359:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+7:14113:x1874219323442560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395156.031368:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395156.031388:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8fbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a8fb8 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.031408:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a8fb8 expref: 8 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.031417:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c400/0xedbabbe2e89a8fbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a8fb8 expref: 8 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.031425:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c400, rc 0) 00000100:00100000:3.0:1787395156.031681:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+8:14113:x1874219323442560:12345-0@lo:101:mount.lustre.0 Request processed in 322us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.031689:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787395156.031777:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395156.031789:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fbf expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.031798:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a8fbf expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395156.031847:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395156.031869:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395156.031897:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302dde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.031943:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442688 00000100:00100000:3.0:1787395156.031947:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442688 00000100:00100000:3.0:1787395156.031978:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787395156.031986:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+8:14113:x1874219323442688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395156.032367:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14113:x1874219323442688:12345-0@lo:501:mount.lustre.0 Request processed in 381us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.032617:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787395156.032742:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395156.032776:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395156.032816:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395156.032843:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302dde3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.032889:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442816 00000100:00100000:3.0:1787395156.032893:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442816 00000100:00100000:3.0:1787395156.032925:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787395156.032931:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14113:x1874219323442816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787395156.033248:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14113:x1874219323442816:12345-0@lo:503:mount.lustre.0 Request processed in 316us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.033254:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787395156.033749:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323442816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395156.034128:0:14149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14149:1874219323442944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787395156.034173:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.034206:0:14149:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308346c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.034261:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323442944 00000100:00100000:2.0:1787395156.034266:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323442944 00000100:00100000:2.0:1787395156.034302:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787395156.034335:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14149:x1874219323442944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787395156.035055:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14149:x1874219323442944:12345-0@lo:502:llog_process_th.0 Request processed in 719us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.035064:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787395156.035214:0:14149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14149:1874219323442944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787395156.035239:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787395156.035250:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395156.035252:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787395156.035257:0:14149:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787395156.035260:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787395156.035272:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa0b33f9399c0) 00000020:00000080:0.0:1787395156.035287:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787395156.035291:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787395156.035770:0:14149:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787395156.035778:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a8fcd 00000020:00000080:0.0:1787395156.035999:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787395156.036005:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787395156.036009:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395156.036011:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787395156.036014:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787395156.036017:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395156.036019:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787395156.036022:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787395156.036030:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa0b33f938000) 00000020:00000080:0.0:1787395156.036042:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787395156.036046:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787395156.036048:0:14149:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787395156.036052:0:14149:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787395156.036063:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787395156.036103:0:14149:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b336008000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787395156.036124:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa0b3367019c0) 00000020:00000080:0.0:1787395156.036133:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787395156.036188:0:14149:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787395156.036194:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a8fe2 00000020:00000080:0.0:1787395156.036283:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787395156.036288:0:14149:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787395156.036299:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xedbabbe2e89a8fe9 00080000:01000000:0.0:1787395156.036638:0:14149:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787395156.036646:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a8ff0 00010000:00010000:1.0:1787395156.100781:0:14149:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787395156.101403:0:14149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1787395156.101727:0:14149:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787395156.102507:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa0b305ce99c0) 00000020:00000080:1.0:1787395156.102527:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787395156.102587:0:14149:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787395156.102593:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a8ffe 00000020:00000080:1.0:1787395156.105879:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787395156.108982:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xedbabbe2e89a9005 00000020:00000080:2.0:1787395156.117662:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787395156.117676:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787395156.117684:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395156.117685:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787395156.117689:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787395156.117695:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395156.117696:0:14149:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787395156.117700:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787395156.117758:0:14149:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787395156.117779:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787395156.117783:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395156.117785:0:14149:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787395156.117787:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787395156.117789:0:14149:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787395156.117790:0:14149:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787395156.117792:0:14149:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787395156.117793:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787395156.117795:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395156.117797:0:14149:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787395156.117799:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787395156.117802:0:14149:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787395156.117805:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395156.117806:0:14149:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787395156.117810:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787395156.117820:0:14149:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:2.0:1787395156.117844:0:14149:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787395156.117847:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787395156.117861:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa0b318db8000) 00000020:00000080:2.0:1787395156.117875:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787395156.117880:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787395156.117937:0:14149:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787395156.117942:0:14149:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787395156.117949:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a9013 00010000:00080000:2.0:1787395156.117979:0:14149:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b305248800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787395156.119240:0:14149:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787395156.119771:0:14149:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787395156.119818:0:14149:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787395156.122832:0:14149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787395156.122929:0:14149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787395156.123026:0:14149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787395156.124125:0:14153:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787395156.124131:0:14153:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787395156.125014:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787395156.125034:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787395156.125067:0:14149:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787395156.125099:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a901a 00000100:00080000:1.0:1787395156.125110:0:14149:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787395156.125116:0:14149:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0b305248800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787395156.125149:0:14149:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b327e75180 x1874219323443072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787395156.125172:0:14149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787395156.125229:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.125232:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.125234:0:14149:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787395156.125237:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787395156.125240:0:14149:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787395156.125241:0:14149:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787395156.125243:0:14149:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787395156.125245:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787395156.125247:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.125249:0:14149:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787395156.125251:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787395156.125256:0:14149:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787395156.125259:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.125261:0:14149:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787395156.125263:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787395156.125267:0:14149:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1787395156.125287:0:14149:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787395156.125290:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787395156.125300:0:14149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa0b305ce8000) 00000020:00000080:1.0:1787395156.125347:0:14149:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787395156.125353:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787395156.125417:0:14149:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787395156.125422:0:14149:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787395156.125432:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xedbabbe2e89a9028 00010000:00080000:1.0:1787395156.125461:0:14149:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b30524b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1787395156.125654:0:14149:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787395156.125821:0:14149:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787395156.125842:0:14149:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787395156.126303:0:14149:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787395156.126423:0:14149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787395156.126505:0:14149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787395156.127017:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787395156.127031:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323443200:0@lo:400:kworker.0 00000100:00100000:2.0:1787395156.127106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395156.127156:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443200 00000100:00100000:2.0:1787395156.127163:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443200 00000100:00100000:2.0:1787395156.127198:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787395156.127206:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:3304:x1874219323443200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395156.127253:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:3304:x1874219323443200:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.127260:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787395156.127340:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323443200:0@lo:400:kworker.0 00000100:00100000:3.0:1787395156.127543:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323443072:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787395156.127572:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874219323443072 offset 0 length 520: 4 00000040:00080000:3.0:1787395156.128794:0:14155:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787395156.128800:0:14155:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787395156.129652:0:14149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787395156.129665:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787395156.129698:0:14149:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787395156.129719:0:14149:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a902f 00000100:00080000:1.0:1787395156.129727:0:14149:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787395156.129733:0:14149:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b30524b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787395156.129764:0:14149:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b327e75f80 x1874219323443328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787395156.129822:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323443328:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787395156.129883:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874219323443328 offset 0 length 520: 4 00000100:00080000:1.0:1787395156.129928:0:14149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787395156.129992:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.129996:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.129998:0:14149:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787395156.130000:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395156.130004:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.130005:0:14149:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787395156.130008:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787395156.130010:0:14149:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787395156.130012:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.130014:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.130015:0:14149:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787395156.130017:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395156.130019:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.130020:0:14149:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787395156.130024:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787395156.130068:0:14149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14149:1874219323443456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787395156.130126:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.130141:0:14149:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3082969c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.130598:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443456 00000100:00100000:2.0:1787395156.130605:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443456 00000100:00100000:2.0:1787395156.130660:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787395156.130669:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14149:x1874219323443456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787395156.130982:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14149:x1874219323443456:12345-0@lo:502:llog_process_th.0 Request processed in 313us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.130990:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787395156.131257:0:14149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14149:1874219323443456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787395156.131287:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787395156.131293:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395156.131295:0:14149:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787395156.131299:0:14149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787395156.131900:0:14113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787395156.131922:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787395156.131970:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fbf expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.131982:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48800/0xedbabbe2e89a8fb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fbf expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395156.131991:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b336008000 from 1 10000000:01000000:2.0:1787395156.131994:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787395156.132025:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.132043:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.132053:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395156.132071:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787395156.132119:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395156.132152:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302dde900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395156.132256:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443584 00000100:00100000:1.0:1787395156.132262:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443584 00000100:00100000:1.0:1787395156.132297:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787395156.132331:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+9:14113:x1874219323443584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395156.132343:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395156.132359:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9036 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.132381:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.132391:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 10 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.132399:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395156.132441:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+10:14113:x1874219323443584:12345-0@lo:101:mount.lustre.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395156.132447:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787395156.132585:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395156.132598:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.132606:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395156.133149:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787395156.133186:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395156.133249:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80900 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.133453:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443712 00000100:00100000:2.0:1787395156.133460:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443712 00000100:00100000:2.0:1787395156.133524:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787395156.133531:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+10:14113:x1874219323443712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787395156.133547:0:14124:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787395156.133553:0:14124:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787395156.133624:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+10:14113:x1874219323443712:12345-0@lo:256:mount.lustre.0 Request processed in 93us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.133631:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787395156.133814:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443712:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787395156.134654:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787395156.134907:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.134921:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395156.134929:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b336008000 from 1 10000000:01000000:3.0:1787395156.134932:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787395156.134968:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.134976:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395156.134985:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395156.135004:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787395156.135058:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395156.135099:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80900 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.135158:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443840 00000100:00100000:2.0:1787395156.135165:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443840 00000100:00100000:2.0:1787395156.135216:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787395156.135225:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+10:14113:x1874219323443840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395156.135238:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395156.135252:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9044 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.135276:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.135287:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.135296:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49400, rc 0) 00000100:00100000:2.0:1787395156.135359:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323443840:12345-0@lo:101:mount.lustre.0 Request processed in 135us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.135367:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787395156.135539:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443840:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395156.135553:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.135562:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.135613:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395156.135652:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.135669:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296540 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.135775:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323443968 00000100:00100000:2.0:1787395156.135780:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323443968 00000100:00100000:2.0:1787395156.135809:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787395156.135815:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323443968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395156.136379:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323443968:12345-0@lo:501:mount.lustre.0 Request processed in 562us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.136387:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787395156.136733:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323443968:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395156.136772:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444096:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787395156.136812:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.136882:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296540 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.136917:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444096 00000100:00100000:2.0:1787395156.136922:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444096 00000100:00100000:2.0:1787395156.136988:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787395156.136996:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323444096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395156.137299:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323444096:12345-0@lo:503:mount.lustre.0 Request processed in 303us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.137429:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787395156.137547:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395156.137873:0:14157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14157:1874219323444224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787395156.137912:0:14157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.137944:0:14157:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30a9f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.137988:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444224 00000100:00100000:3.0:1787395156.137993:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444224 00000100:00100000:3.0:1787395156.138026:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787395156.138189:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14157:x1874219323444224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395156.138598:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14157:x1874219323444224:12345-0@lo:502:llog_process_th.0 Request processed in 564us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.138606:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787395156.138759:0:14157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14157:1874219323444224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787395156.138787:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395156.138797:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.138799:0:14157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787395156.138806:0:14157:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b336008000 00000020:00000080:1.0:1787395156.138808:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787395156.138817:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.138819:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.138820:0:14157:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787395156.138823:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395156.138825:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.138827:0:14157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787395156.138831:0:14157:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b336008000 00000020:00000080:1.0:1787395156.138833:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787395156.138917:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.138922:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.138923:0:14157:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787395156.138925:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395156.138928:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.138929:0:14157:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787395156.138932:0:14157:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b336008000 00000020:00000080:1.0:1787395156.138934:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787395156.145512:0:14157:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14157:1874219323444352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787395156.145610:0:14157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.145692:0:14157:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.155496:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444352 00000100:00100000:3.0:1787395156.155512:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444352 00000100:00100000:3.0:1787395156.155563:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787395156.155572:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14157:x1874219323444352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787395156.155832:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14157:x1874219323444352:12345-0@lo:502:llog_process_th.0 Request processed in 260us (10221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.155839:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787395156.156282:0:14157:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14157:1874219323444352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787395156.156801:0:14157:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395156.156811:0:14157:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395156.156813:0:14157:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787395156.156819:0:14157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787395156.157400:0:14113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787395156.157424:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787395156.157443:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.157455:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395156.157506:0:14113:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787395156.157510:0:14113:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b336008000 10000000:01000000:0.0:1787395156.157512:0:14113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b336008000 10000000:01000000:0.0:1787395156.157516:0:14113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787395156.157526:0:14113:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b336008000 from 1 10000000:01000000:0.0:1787395156.157529:0:14113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787395156.157561:0:14113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.157571:0:14113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.157580:0:14113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395156.157601:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787395156.157648:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.157686:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60480 going to sleep for 11 seconds 00000100:00100000:2.0:1787395156.157747:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444480 00000100:00100000:2.0:1787395156.157753:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444480 00000100:00100000:2.0:1787395156.157790:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787395156.157798:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323444480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395156.157809:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395156.157820:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa49c00/0xedbabbe2e89a9059 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9052 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.157841:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa49c00/0xedbabbe2e89a9059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9052 expref: 12 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.157851:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa49c00/0xedbabbe2e89a9059 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9052 expref: 12 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395156.157860:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa49c00, rc 0) 00000100:00100000:2.0:1787395156.157933:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323444480:12345-0@lo:101:mount.lustre.0 Request processed in 136us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.157948:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787395156.166249:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787395156.166277:0:14113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9059 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.166290:0:14113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a9059 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395156.166497:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395156.166555:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.166600:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60480 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.168217:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444608 00000100:00100000:3.0:1787395156.168229:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444608 00000100:00100000:3.0:1787395156.168341:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787395156.168351:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323444608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395156.168641:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323444608:12345-0@lo:501:mount.lustre.0 Request processed in 290us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.168648:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787395156.171260:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395156.171397:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395156.171479:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.171530:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b60480 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.171693:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444736 00000100:00100000:3.0:1787395156.171701:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444736 00000100:00100000:3.0:1787395156.171821:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787395156.171830:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323444736:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787395156.172000:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323444736:12345-0@lo:503:mount.lustre.0 Request processed in 170us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395156.172007:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787395156.172096:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323444736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395156.172544:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14162:1874219323444864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787395156.172578:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.172606:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3396010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395156.172647:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444864 00000100:00100000:1.0:1787395156.172652:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444864 00000100:00100000:1.0:1787395156.172673:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787395156.172680:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14162:x1874219323444864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787395156.172853:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14162:x1874219323444864:12345-0@lo:502:llog_process_th.0 Request processed in 173us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395156.172860:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787395156.172926:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14162:1874219323444864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787395156.172978:0:14162:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787395156.172992:0:14162:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa0b336700000) 00000020:00000080:0.0:1787395156.173012:0:14162:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787395156.173170:0:14162:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b336008000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787395156.173175:0:14162:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b336008000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787395156.173177:0:14162:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b336008000 4 00010000:00080000:0.0:1787395156.173200:0:14162:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b304318000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787395156.176869:0:14162:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787395156.176973:0:14162:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787395156.177008:0:14162:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787395156.177021:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xedbabbe2e89a9067 00000100:00080000:0.0:1787395156.177042:0:14162:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787395156.177048:0:14162:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0b304318000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395156.177081:0:14162:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa51180 x1874219323444992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787395156.177113:0:14162:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787395156.177252:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323444992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787395156.177416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.178147:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323444992 00000100:00100000:0.0:1787395156.178156:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323444992 00000100:00100000:0.0:1787395156.178188:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395156.178196:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323444992:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787395156.178264:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323444992:12345-0@lo:38:llog_process_th.0 Request processed in 68us (848us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787395156.178279:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395156.178423:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787395156.178430:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b304318000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787395156.178434:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787395156.178439:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323444992:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787395156.178635:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14162:1874219323445120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787395156.178681:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395156.178705:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b339601c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787395156.178811:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445120 00000100:00100000:1.0:1787395156.178815:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445120 00000100:00100000:1.0:1787395156.178849:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787395156.178856:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14162:x1874219323445120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787395156.179453:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14162:x1874219323445120:12345-0@lo:502:llog_process_th.0 Request processed in 597us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395156.179466:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787395156.179562:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14162:1874219323445120:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787395156.179585:0:14162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787395156.179751:0:14113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787395156.179772:0:14113:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787395156.179785:0:14113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9059 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.179794:0:14113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341010c00/0xedbabbe2e89a9052 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9059 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787395156.179848:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787395156.179851:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.179852:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.179854:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.179855:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.179856:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.179857:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.179859:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.179860:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.179861:0:14113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787395156.179865:0:14113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787395156.179867:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787395156.179868:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.179869:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.179870:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.179871:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.179872:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.179873:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.179874:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.179875:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.179876:0:14113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787395156.179890:0:14113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787395156.179900:0:14113:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323445248:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787395156.179930:0:14113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.179958:0:14113:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296840 going to sleep for 11 seconds 00000100:00100000:3.0:1787395156.180188:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445248 00000100:00100000:3.0:1787395156.180193:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445248 00000100:00100000:3.0:1787395156.180233:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787395156.180240:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14113:x1874219323445248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787395156.180260:0:14125:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787395156.180273:0:14125:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787395156.239114:0:14125:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787395156.239139:0:14125:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787395156.239517:0:14147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787395156.239522:0:14147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787395156.239543:0:14147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.239563:0:14147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.239571:0:14147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.239611:0:14147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.239625:0:14147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 12 pid: 14125 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.239641:0:14147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323445376:0@lo:104: 00000100:00100000:1.0:1787395156.239696:0:14147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.239731:0:14147:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787395156.240082:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445376 00000100:00100000:0.0:1787395156.240090:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445376 00000100:00100000:0.0:1787395156.240137:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395156.240146:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323445376:12345-0@lo:104: 00010000:00010000:0.0:1787395156.240159:0:14114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240209:0:14114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787395156.240214:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323445376:12345-0@lo:104: Request processed in 71us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395156.240222:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787395156.240241:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395156.240247:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240255:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48e00 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395156.240260:0:14120:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.240273:0:14147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323445376:0@lo:104: 00010000:00010000:0.0:1787395156.240288:0:14120:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395156.240297:0:14120:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240298:0:14147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395156.240329:0:14120:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787395156.240362:0:14120:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240369:0:14120:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787395156.240390:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240397:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48e00/0xedbabbe2e89a9036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a903d expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240411:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395156.240413:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395156.240414:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395156.240422:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323445504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395156.240451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395156.240572:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445504 00000100:00100000:1.0:1787395156.240577:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445504 00010000:00010000:1.0:1787395156.240592:0:14116:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 13 pid: 14125 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395156.240633:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395156.240641:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+13:3304:x1874219323445504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787395156.240652:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395156.240657:0:14116:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 13 pid: 14125 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240667:0:14116:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 13 pid: 14125 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240681:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b339128200/0xedbabbe2e89a903d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9036 expref: 13 pid: 14125 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240694:0:14116:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240702:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787395156.240714:0:14116:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001191996s 00010000:00010000:1.0:1787395156.240718:0:14116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240725:0:14116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240731:0:14116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240738:0:14116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240749:0:14116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395156.240754:0:14116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240761:0:14116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240781:0:14116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395156.240791:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395156.240818:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:3304:x1874219323445504:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395156.240825:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395156.240848:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323445504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395156.240884:0:14147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240893:0:14147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395156.240899:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b339129800/0xedbabbe2e89a906e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395156.257737:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14113:x1874219323445248:12345-0@lo:253:mount.lustre.0 Request processed in 77489us (77797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395156.257751:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787395156.257858:0:14113:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14113:1874219323445248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787395156.257873:0:14113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787395156.257877:0:14113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787395156.257878:0:14113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787395156.257879:0:14113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395156.257880:0:14113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395156.257882:0:14113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395156.257883:0:14113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395156.257884:0:14113:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787395156.257886:0:14113:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787395156.257887:0:14113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395156.257889:0:14113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787395156.257904:0:14113:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787395156.265080:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787395156.265254:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787395156.265575:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787395156.265732:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787395156.265999:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787395156.266150:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787395156.267183:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787395156.267382:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787395156.267866:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787395156.268201:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787395156.268532:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787395156.268713:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787395156.307248:0:14113:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787395156.307779:0:14113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787395156.308048:0:14170:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787395156.308113:0:14170:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787395156.310459:0:14113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787395156.310592:0:14113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787395156.324205:0:14170:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787395156.324291:0:14170:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787395156.324296:0:14170:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1787395156.324615:0:14169:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787395156.324621:0:14169:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1787395156.327285:0:14113:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787395156.327532:0:14113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787395156.327776:0:14113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787395156.329872:0:14113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787395156.330657:0:14113:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787395156.330714:0:14113:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787395156.332133:0:14113:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787395156.337087:0:14113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787395156.363628:0:14113:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787395156.363666:0:14113:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba80c0c87988 00100000:10000000:1.0:1787395156.363674:0:14113:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787395156.364504:0:14113:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787395156.364520:0:14113:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787395156.364532:0:14113:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787395156.364556:0:14113:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787395156.946951:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787395157.203851:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1787395157.522904:0:14128:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787395157.522910:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b336008000 from 6 10000000:01000000:2.0:1787395157.522913:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787395157.522959:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395157.522971:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395157.522982:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395157.523008:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323445632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787395157.523073:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395157.523124:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787395157.523182:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445632 00000100:00100000:3.0:1787395157.523191:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445632 00000100:00100000:3.0:1787395157.523241:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787395157.523252:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14128:x1874219323445632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395157.523265:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395157.523278:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9075 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395157.523302:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395157.523679:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395157.523689:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395157.523734:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323445632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 484us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395157.523750:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787395157.524477:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323445632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395157.524496:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395157.524513:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395157.524563:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323445760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787395157.524598:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395157.524635:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787395157.524938:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445760 00000100:00100000:0.0:1787395157.524945:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445760 00000100:00100000:0.0:1787395157.524983:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787395157.524991:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323445760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787395157.525007:0:14125:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787395157.525024:0:14125:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787395157.525028:0:14125:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787395157.537947:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323445760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 12949us (13340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395157.537961:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787395157.538067:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323445760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787395157.538125:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787395157.538135:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395157.538146:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395157.970818:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787395158.228692:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787395158.998529:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395160.031287:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395161.044024:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787395161.684060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787395161.684068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787395161.684070:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787395161.684073:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787395161.684076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787395161.684078:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787395161.684082:0:37:0:(import.c:65:import_set_state_nolock()) ffffa0b304318000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787395161.684094:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa0b304318000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787395161.684183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b33677f100 x1874219323446016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787395161.684300:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3305:1874219323445888:0@lo:400:kworker.0 00000100:00100000:2.0:1787395161.684387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395161.684474:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323445888 00000100:00100000:2.0:1787395161.684482:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323445888 00000100:00100000:2.0:1787395161.684525:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787395161.684533:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:3305:x1874219323445888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395161.684608:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:3305:x1874219323445888:12345-0@lo:400:kworker.0 Request processed in 75us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395161.684617:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787395161.684652:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323446016:0@lo:38:kworker.0 00000100:00100000:2.0:1787395161.684681:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395161.684724:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446016 00000100:00100000:2.0:1787395161.684728:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446016 00000100:00100000:2.0:1787395161.684754:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787395161.684759:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1874219323446016:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787395161.684780:0:14133:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:2.0:1787395161.684821:0:14133:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xedbabbe2e89a9083 00000004:00100000:2.0:1787395161.684835:0:14133:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787395161.684948:0:14133:0:(import.c:65:import_set_state_nolock()) ffffa0b305122800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395161.684987:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874219323446016:12345-0@lo:38:kworker.0 Request processed in 226us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395161.684993:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787395161.685025:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0b33677f100 x1874219323446016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787395171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787395161.685039:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787395161.685045:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787395161.685050:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787395161.685053:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b304318000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787395161.685059:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874219323446016:0@lo:38:kworker.0 00000100:00100000:2.0:1787395161.685085:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3305:1874219323445888:0@lo:400:kworker.0 00010000:00010000:1.0:1787395162.068363:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787395162.346138:0:14413:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787395163.096561:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395164.115173:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395165.138508:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787395165.770275:0:14564:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffca3b83490 00000020:00000080:0.0:1787395165.770294:0:14564:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787395165.770300:0:14564:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787395165.770340:0:14564:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3b85720 20000000:00000080:0.0:1787395165.770348:0:14564:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b33ab25c00 uarg=0000000000000000 20000000:01000000:0.0:1787395165.770382:0:14564:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787395165.770389:0:14564:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787395165.770393:0:14564:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787395165.773076:0:14565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787395165.773260:0:14564:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787395165.782362:0:14564:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787395165.782494:0:14564:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.782515:0:14564:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.782523:0:14564:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.782567:0:14564:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.782581:0:14564:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395165.782596:0:14564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14564:1874219323446144:0@lo:104: 00000100:00100000:3.0:1787395165.782659:0:14564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395165.782714:0:14564:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302ddee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787395165.783449:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446144 00000100:00100000:2.0:1787395165.783462:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446144 00000100:00100000:2.0:1787395165.783503:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787395165.783512:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14564:x1874219323446144:12345-0@lo:104: 00010000:00010000:2.0:1787395165.783525:0:14115:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395165.783602:0:14115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787395165.783608:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14564:x1874219323446144:12345-0@lo:104: Request processed in 98us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395165.783616:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787395165.783665:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395165.783673:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.783681:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:0.0:1787395165.783685:0:14120:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.783694:0:14120:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787395165.783701:0:14120:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395165.783708:0:14120:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787395165.783744:0:14120:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.783751:0:14120:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787395165.783766:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.783772:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9044 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a904b expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.783790:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395165.783792:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395165.783794:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395165.783841:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323446272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787395165.783870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395165.783947:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446272 00000100:00100000:0.0:1787395165.783952:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446272 00010000:00010000:0.0:1787395165.783969:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 12 pid: 14124 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395165.784007:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787395165.784014:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:3306:x1874219323446272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787395165.784024:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395165.784030:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 12 pid: 14124 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784039:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 12 pid: 14124 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784056:0:14117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784064:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784088:0:14117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784097:0:14117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784104:0:14117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784109:0:14117:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784114:0:14117:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c000 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395165.784118:0:14117:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784131:0:14117:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784141:0:14117:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395165.784150:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395165.784189:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:3306:x1874219323446272:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395165.784195:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787395165.784681:0:14564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33fa49400/0xedbabbe2e89a904b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9044 expref: 11 pid: 14124 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395165.784692:0:14564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14564:1874219323446144:0@lo:104: 00010000:00010000:3.0:1787395165.784709:0:14564:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.784718:0:14564:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.784732:0:14564:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395165.784738:0:14564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55c000/0xedbabbe2e89a908a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14564 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395165.785374:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323446272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787395166.162573:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787395166.802617:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787395166.802625:0:12633:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787395166.802628:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787395166.802631:0:12633:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787395166.802682:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323446400:0@lo:400:kworker.0 00000100:00100000:3.0:1787395166.802770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395166.802830:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787395166.802835:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323446528:0@lo:400:kworker.0 00000100:00100000:3.0:1787395166.802868:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395166.802920:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446528 00000100:00100000:3.0:1787395166.802940:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446528 00000100:00100000:3.0:1787395166.802989:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787395166.802999:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323446528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395166.803051:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323446528:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395166.803059:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787395166.803227:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa0b33676bb80 x1874219323446528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395166.803245:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323446528:0@lo:400:kworker.0 00000100:00100000:0.0:1787395166.804508:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446400 00000100:00100000:0.0:1787395166.804520:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446400 00000100:00100000:0.0:1787395166.804577:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787395166.804587:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:3303:x1874219323446400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395166.804667:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:3303:x1874219323446400:12345-0@lo:400:kworker.0 Request processed in 81us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395166.804675:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787395166.806135:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395156/real 1787395156] req@ffffa0b327e75f80 x1874219323443328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395166.806170:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b327e75f80 x1874219323443328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395166.806181:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395156/real 1787395156] req@ffffa0b327e75180 x1874219323443072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395166 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787395166.806192:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b327e75180 x1874219323443072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395166 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787395166.806213:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787395166.806231:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787395166.806235:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323443328:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787395166.806241:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b305248800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787395166.806245:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787395166.806248:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323443072:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787395166.806303:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323446400:0@lo:400:kworker.0 00000100:00080000:0.0:1787395166.806508:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395166.806513:0:12633:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787395166.806516:0:12633:0:(import.c:65:import_set_state_nolock()) ffffa0b305248800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787395166.806532:0:12633:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1787395166.806538:0:12633:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787395166.806545:0:12633:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0b305248800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395166.806583:0:12633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa50380 x1874219323446656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787395166.806609:0:12633:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395166.806619:0:12633:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787395166.806621:0:12633:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787395166.806625:0:12633:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1787395166.806628:0:12633:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787395166.806632:0:12633:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b30524b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395166.806644:0:12633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa50e00 x1874219323446784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787395166.806953:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323446656:0@lo:8:kworker.0 00000400:00000100:3.0:1787395166.807004:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874219323446656 offset 0 length 520: 4 00000100:00100000:3.0:1787395166.807039:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323446784:0@lo:8:kworker.0 00000400:00000100:3.0:1787395166.807052:0:3302:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874219323446784 offset 0 length 520: 4 10000000:01000000:2.0:1787395167.058408:0:14128:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787395167.058417:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b336008000 from 10 10000000:01000000:2.0:1787395167.058424:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787395167.058467:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395167.058480:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395167.058492:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395167.058516:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323446912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787395167.058599:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395167.058654:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80540 going to sleep for 11 seconds 00000100:00100000:0.0:1787395167.058919:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323446912 00000100:00100000:0.0:1787395167.058927:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323446912 00000100:00100000:0.0:1787395167.058984:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787395167.058993:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+11:14128:x1874219323446912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787395167.059009:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395167.059024:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9091 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395167.059047:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395167.059057:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395167.059067:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011a00, rc 0) 00000100:00100000:0.0:1787395167.059120:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323446912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395167.059127:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787395167.059678:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323446912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395167.059697:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395167.059722:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395167.059791:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323447040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787395167.059821:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395167.059860:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302d80540 going to sleep for 11 seconds 00000100:00100000:1.0:1787395167.059916:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447040 00000100:00100000:1.0:1787395167.059921:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447040 00000100:00100000:1.0:1787395167.059963:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787395167.059970:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323447040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395167.060229:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323447040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395167.060236:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787395167.060285:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323447040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395167.060345:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323447168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395167.060581:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395167.060605:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787395167.060619:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447168 00000100:00100000:1.0:1787395167.060624:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447168 00000100:00100000:1.0:1787395167.060650:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787395167.060656:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323447168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395167.060798:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14128:x1874219323447168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395167.060805:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787395167.060854:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323447168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787395167.062873:0:14615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787395167.066056:0:14128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787395167.066107:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787395167.066118:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395167.066143:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395167.187378:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395168.223594:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395168.494511:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787395169.238965:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395170.267248:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787395171.049103:0:14765:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787395171.049108:0:14765:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787395171.049218:0:14765:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0b337f3f800 00000020:01000004:2.0:1787395171.049238:0:14765:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787395171.049250:0:14765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787395171.049262:0:14765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa0b318db99c0) 00000020:00000080:2.0:1787395171.049284:0:14765:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787395171.066544:0:14765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787395171.066802:0:14765:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787395171.067803:0:14765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787395171.068206:0:14765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787395171.068587:0:14765:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787395171.068987:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 227: rc = 0 00100000:10000000:3.0:1787395171.069200:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 227: rc = 0 00100000:10000000:3.0:1787395171.069296:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 227: rc = 0 00100000:10000000:3.0:1787395171.069752:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 702: rc = 0 00100000:10000000:3.0:1787395171.070195:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 702: rc = 0 00100000:10000000:3.0:1787395171.070680:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 702: rc = 0 00100000:10000000:3.0:1787395171.070980:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 702: rc = 0 00100000:10000000:3.0:1787395171.071688:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 702: rc = 0 00100000:10000000:3.0:1787395171.071989:0:14765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 702: rc = 0 00000020:00000080:3.0:1787395171.072590:0:14765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787395171.072600:0:14765:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787395171.072609:0:14765:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedbabbe2e89a90a6 00000020:01000004:3.0:1787395171.072617:0:14765:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787395171.072636:0:14765:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787395171.072640:0:14765:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787395171.072645:0:14765:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787395171.072650:0:14765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787395171.072661:0:14765:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa0b3411d3380) 00000020:00000080:3.0:1787395171.072670:0:14765:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787395171.075478:0:14765:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787395171.075659:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787395171.075665:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787395171.079546:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787395171.079562:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787395171.079974:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787395171.079984:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787395171.081711:0:14765:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787395171.083257:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787395171.083267:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787395171.087591:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787395171.087605:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787395171.110584:0:14765:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787395171.111534:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787395171.111541:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787395171.113292:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787395171.113731:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787395171.115064:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787395171.115076:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787395171.118019:0:14765:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787395171.118292:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787395171.118299:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787395171.119821:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787395171.119905:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787395171.155938:0:14765:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787395171.156117:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787395171.156123:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787395171.157233:0:14765:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787395171.157241:0:14765:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787395171.157946:0:14765:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787395171.157968:0:14765:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787395171.157975:0:14765:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787395171.166607:0:14765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787395171.166649:0:14765:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787395171.166654:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787395171.166655:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787395171.166657:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787395171.166658:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787395171.166659:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787395171.166660:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787395171.166661:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787395171.166663:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787395171.166664:0:14765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787395171.166667:0:14765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787395171.166669:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787395171.166670:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787395171.166671:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787395171.166672:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787395171.166673:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787395171.166674:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787395171.166675:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787395171.166676:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787395171.166677:0:14765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787395171.166702:0:14765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787395171.166721:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787395171.166781:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.166933:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18180 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.166980:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447296 00000100:00100000:1.0:1787395171.166987:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447296 00000100:00100000:1.0:1787395171.167083:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787395171.167092:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14765:x1874219323447296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787395171.167118:0:14125:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787395171.167126:0:14125:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787395171.167129:0:14125:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787395171.185063:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14765:x1874219323447296:12345-0@lo:253:mount.lustre.0 Request processed in 17962us (18270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395171.185078:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787395171.185169:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787395171.185188:0:14765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787395171.185191:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787395171.185193:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787395171.185194:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787395171.185195:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787395171.185197:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787395171.185198:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787395171.185199:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787395171.185201:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787395171.185202:0:14765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787395171.185515:0:14765:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b337f3f800 from lustre-OST0000 10000000:01000000:3.0:1787395171.185546:0:14765:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787395171.185549:0:14765:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787395171.185555:0:14765:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0b33f93b380 local copy 00010000:00010000:3.0:1787395171.185565:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395171.185793:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395171.185908:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.186060:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.186101:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447424 00000100:00100000:2.0:1787395171.186108:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447424 00000100:00100000:2.0:1787395171.186201:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787395171.186224:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14765:x1874219323447424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395171.186423:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14765:x1874219323447424:12345-0@lo:501:mount.lustre.0 Request processed in 214us (591us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787395171.186431:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787395171.186513:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447424:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787395171.186526:0:14765:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787395171.186667:0:14765:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787395171.186673:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.186682:0:14765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395171.186706:0:14765:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b337f3f800 10000000:01000000:3.0:1787395171.186718:0:14765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787395171.186722:0:14765:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa0b33f93b380 10000000:01000000:3.0:1787395171.186725:0:14765:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787395171.186728:0:14765:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa0b33f93b380 from 1 10000000:01000000:3.0:1787395171.186730:0:14765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787395171.186754:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.186762:0:14765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.186769:0:14765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395171.186781:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787395171.186806:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.187546:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.187620:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447552 00000100:00100000:1.0:1787395171.187626:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447552 00000100:00100000:1.0:1787395171.187657:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787395171.187664:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+12:14765:x1874219323447552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395171.187674:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395171.187687:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339129a00/0xedbabbe2e89a90bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a90b4 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.187710:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339129a00/0xedbabbe2e89a90bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a90b4 expref: 13 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.187720:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339129a00/0xedbabbe2e89a90bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a90b4 expref: 13 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.187729:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129a00, rc 0) 00000100:00100000:1.0:1787395171.187807:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+13:14765:x1874219323447552:12345-0@lo:101:mount.lustre.0 Request processed in 144us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.187813:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787395171.187995:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395171.188009:0:14765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90bb expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.188017:0:14765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a90bb expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395171.188035:0:14765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787395171.188054:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90bb expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.188061:0:14765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55dc00/0xedbabbe2e89a90b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90bb expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395171.188084:0:14765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787395171.188088:0:14765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787395171.188093:0:14765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787395171.188095:0:14765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787395171.188112:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.188120:0:14765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.188127:0:14765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395171.188142:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787395171.188171:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.188193:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.188470:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447680 00000100:00100000:2.0:1787395171.188475:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447680 00000100:00100000:2.0:1787395171.188503:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787395171.188509:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+13:14765:x1874219323447680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395171.188516:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395171.188524:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a90c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a90c2 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.188536:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a90c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a90c2 expref: 14 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.188544:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48000/0xedbabbe2e89a90c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a90c2 expref: 14 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.188550:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48000, rc 0) 00000100:00100000:2.0:1787395171.188575:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323447680:12345-0@lo:101:mount.lustre.0 Request processed in 66us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.188580:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787395171.188755:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395171.188766:0:14765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90c9 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.188773:0:14765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a90c9 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787395171.189748:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787395171.191191:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787395171.197160:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787395171.197545:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787395171.197601:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787395171.197664:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787395171.197704:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787395171.197738:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787395171.197817:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787395171.197826:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787395171.198066:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395171.198133:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.198183:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.198467:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447808 00000100:00100000:2.0:1787395171.198475:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447808 00000100:00100000:2.0:1787395171.198608:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787395171.198617:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323447808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395171.199042:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323447808:12345-0@lo:501:mount.lustre.0 Request processed in 425us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.199056:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787395171.199126:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395171.199157:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787395171.199192:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.199646:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395171.199711:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323447936 00000100:00100000:0.0:1787395171.199717:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323447936 00000100:00100000:0.0:1787395171.199744:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787395171.199751:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323447936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395171.200661:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323447936:12345-0@lo:503:mount.lustre.0 Request processed in 907us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395171.200670:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787395171.200748:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323447936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787395171.202097:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787395171.202176:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787395171.202470:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.202562:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.202602:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448064 00000100:00100000:2.0:1787395171.202608:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448064 00000100:00100000:2.0:1787395171.202686:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787395171.202695:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323448064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395171.202961:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323448064:12345-0@lo:502:mount.lustre.0 Request processed in 267us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.202968:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787395171.203057:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395171.203283:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787395171.203353:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787395171.203392:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787395171.203430:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787395171.203457:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787395171.203480:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787395171.203513:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787395171.203539:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787395171.203576:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787395171.203621:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787395171.203647:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787395171.203679:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787395171.203704:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787395171.203743:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.204194:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.204509:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448192 00000100:00100000:2.0:1787395171.204517:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448192 00000100:00100000:2.0:1787395171.204541:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787395171.204548:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323448192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395171.204719:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323448192:12345-0@lo:502:mount.lustre.0 Request processed in 172us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.204727:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787395171.204807:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395171.204961:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787395171.204983:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787395171.206150:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787395171.206158:0:14779:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787395171.206166:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.206168:0:14779:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787395171.206174:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787395171.206190:0:14779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa0b3411d4d40) 00000020:00000080:3.0:1787395171.206230:0:14779:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787395171.206237:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787395171.206414:0:14779:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b337f3f800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787395171.206422:0:14779:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787395171.206434:0:14779:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xedbabbe2e89a90d7 00010000:00010000:2.0:1787395171.215461:0:14779:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787395171.217199:0:14779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787395171.224298:0:14779:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787395171.226008:0:14779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787395171.226019:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787395171.226025:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226027:0:14779:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787395171.226031:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787395171.226034:0:14779:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787395171.226035:0:14779:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787395171.226037:0:14779:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787395171.226038:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787395171.226040:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226049:0:14779:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787395171.226053:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787395171.226055:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226057:0:14779:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787395171.226059:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787395171.226061:0:14779:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787395171.226063:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787395171.226066:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226067:0:14779:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787395171.226069:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787395171.226071:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226073:0:14779:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787395171.226076:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787395171.226129:0:14779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787395171.226133:0:14779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787395171.226134:0:14779:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787395171.226137:0:14779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787395171.231815:0:14765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787395171.231941:0:14765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787395171.231957:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90c9 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.231981:0:14765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55c000/0xedbabbe2e89a90c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90c9 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395171.231991:0:14765:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b337f3f800 from 1 10000000:01000000:3.0:1787395171.231994:0:14765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787395171.232050:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.232058:0:14765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.232068:0:14765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395171.232092:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787395171.232172:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.232231:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787395171.232453:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448320 00000100:00100000:0.0:1787395171.232461:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448320 00000100:00100000:0.0:1787395171.232504:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787395171.232512:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+14:14765:x1874219323448320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787395171.232526:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395171.232538:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a90de expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395171.232560:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 15 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395171.232570:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 15 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395171.232587:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010800, rc 0) 00000100:00100000:0.0:1787395171.232625:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448320:12345-0@lo:101:mount.lustre.0 Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395171.232632:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787395171.232821:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395171.232908:0:14765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.232917:0:14765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787395171.233695:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787395171.234580:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787395171.236328:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787395171.236490:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787395171.236579:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787395171.236588:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787395171.236685:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395171.236751:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.236791:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787395171.238207:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448448 00000100:00100000:0.0:1787395171.238226:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448448 00000100:00100000:0.0:1787395171.238280:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787395171.238291:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395171.238777:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448448:12345-0@lo:501:mount.lustre.0 Request processed in 487us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395171.238786:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787395171.239968:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395171.240044:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787395171.240101:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.240140:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f300 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.240491:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448576 00000100:00100000:2.0:1787395171.240497:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448576 00000100:00100000:2.0:1787395171.240544:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787395171.240553:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395171.240733:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448576:12345-0@lo:503:mount.lustre.0 Request processed in 181us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.240741:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787395171.240897:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448576:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787395171.241769:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787395171.241835:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787395171.241884:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395171.241916:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b307a9f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.242439:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448704 00000100:00100000:2.0:1787395171.242445:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448704 00000100:00100000:2.0:1787395171.242485:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787395171.242492:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395171.242658:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448704:12345-0@lo:502:mount.lustre.0 Request processed in 166us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.242666:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787395171.243239:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787395171.243719:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787395171.243771:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787395171.243816:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787395171.243850:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787395171.243883:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787395171.243929:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787395171.243965:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787395171.243999:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787395171.244037:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787395171.244201:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395171.244584:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448832 00000100:00100000:2.0:1787395171.244590:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448832 00000100:00100000:2.0:1787395171.244630:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787395171.244637:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395171.244781:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448832:12345-0@lo:502:mount.lustre.0 Request processed in 144us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.244788:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787395171.244836:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b307a9f600 going to sleep for 11 seconds 00000100:00100000:0.0:1787395171.244855:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787395171.244942:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787395171.244953:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787395171.253350:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395171.253367:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253380:0:14783:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787395171.253389:0:14783:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b337f3f800 00000020:00000080:3.0:1787395171.253392:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787395171.253399:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395171.253401:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253403:0:14783:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787395171.253405:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395171.253408:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253409:0:14783:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787395171.253413:0:14783:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b337f3f800 00000020:00000080:3.0:1787395171.253415:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787395171.253471:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395171.253474:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253476:0:14783:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787395171.253478:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787395171.253480:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253482:0:14783:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787395171.253486:0:14783:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b337f3f800 00000020:00000080:3.0:1787395171.253488:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787395171.253522:0:14783:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787395171.253525:0:14783:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395171.253527:0:14783:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787395171.253530:0:14783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787395171.253781:0:14765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787395171.253807:0:14765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787395171.253913:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.253932:0:14765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787395171.253983:0:14765:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787395171.253986:0:14765:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b337f3f800 10000000:01000000:1.0:1787395171.254004:0:14765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b337f3f800 10000000:01000000:1.0:1787395171.254008:0:14765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787395171.254013:0:14765:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b337f3f800 from 1 10000000:01000000:1.0:1787395171.254016:0:14765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787395171.254049:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.254059:0:14765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.254069:0:14765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395171.254091:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787395171.254151:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.254190:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323448960 00000100:00100000:1.0:1787395171.254197:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323448960 00000100:00100000:1.0:1787395171.254629:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787395171.254637:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323448960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395171.254651:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395171.254662:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339129200/0xedbabbe2e89a90f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a90ec expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.254683:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339129200/0xedbabbe2e89a90f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a90ec expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.254692:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339129200/0xedbabbe2e89a90f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a90ec expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.254701:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129200, rc 0) 00000100:00100000:1.0:1787395171.254742:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323448960:12345-0@lo:101:mount.lustre.0 Request processed in 105us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.254749:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787395171.254792:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.254814:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323448960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395171.254827:0:14765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90f3 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.255048:0:14765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a90f3 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787395171.256537:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787395171.257135:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787395171.257593:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787395171.257639:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787395171.257671:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787395171.257716:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787395171.257752:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787395171.257798:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787395171.260300:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787395171.260606:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787395171.260680:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787395171.260736:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787395171.260770:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787395171.260814:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787395171.265054:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787395171.265115:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787395171.265190:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787395171.265520:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787395171.265556:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787395171.265604:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787395171.265652:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787395171.265685:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787395171.265731:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787395171.265765:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787395171.265796:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787395171.266044:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787395171.266083:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787395171.266141:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787395171.266203:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787395171.269122:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787395171.270388:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787395171.270402:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787395171.270502:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395171.270565:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.270609:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449088 00000100:00100000:1.0:1787395171.270616:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449088 00000100:00100000:1.0:1787395171.270657:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787395171.270664:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395171.272065:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449088:12345-0@lo:501:mount.lustre.0 Request processed in 1394us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.272077:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787395171.272132:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.272154:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395171.272191:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787395171.272810:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.272920:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449216 00000100:00100000:1.0:1787395171.272926:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449216 00000100:00100000:1.0:1787395171.272963:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787395171.273302:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787395171.273566:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449216:12345-0@lo:503:mount.lustre.0 Request processed in 268us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.273573:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787395171.274073:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b202bf1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.274095:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449216:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787395171.278702:0:14765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787395171.278785:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787395171.279569:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.279684:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449344 00000100:00100000:1.0:1787395171.279693:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449344 00000100:00100000:1.0:1787395171.279737:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787395171.279744:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787395171.280172:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449344:12345-0@lo:502:mount.lustre.0 Request processed in 426us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.280180:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787395171.280499:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395171.280522:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787395171.283292:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787395171.283782:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787395171.283818:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787395171.284783:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787395171.284917:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787395171.285267:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787395171.285330:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787395171.285553:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787395171.285678:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787395171.285745:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787395171.285776:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787395171.287124:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787395171.287222:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787395171.287258:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787395171.287344:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787395171.287398:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787395171.287434:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787395171.287481:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787395171.287517:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787395171.287550:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787395171.287590:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787395171.290056:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787395171.290101:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787395171.290171:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787395171.290488:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787395171.290559:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787395171.290623:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787395171.290660:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787395171.290695:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787395171.290740:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787395171.290775:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787395171.290807:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787395171.291068:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787395171.291123:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787395171.291161:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00010000:00010000:3.0:1787395171.291333:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787395171.291486:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787395171.291556:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787395171.291590:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787395171.292095:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787395171.292135:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787395171.292184:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449472:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787395171.293156:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.294587:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449472 00000100:00100000:1.0:1787395171.294918:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449472 00000100:00100000:1.0:1787395171.295456:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787395171.295468:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449472:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787395171.297521:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449472:12345-0@lo:502:mount.lustre.0 Request processed in 2047us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395171.297534:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787395171.297753:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787395171.297780:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395171.298447:0:14765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787395171.298464:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787395171.308670:0:14788:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787395171.308687:0:14788:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa0b305cecd40) 00000020:00000080:1.0:1787395171.308710:0:14788:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787395171.312771:0:14788:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b337f3f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787395171.312781:0:14788:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b337f3f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787395171.312784:0:14788:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b337f3f800 3 00010000:00080000:1.0:1787395171.312827:0:14788:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b33f92e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1787395171.320920:0:14788:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787395171.321019:0:14788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787395171.323859:0:14788:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787395171.323883:0:14788:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xedbabbe2e89a9101 00000100:00080000:0.0:1787395171.323895:0:14788:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787395171.323901:0:14788:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa0b33f92e800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395171.323937:0:14788:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa50a80 x1874219323449600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787395171.323990:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323449600:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787395171.324053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395171.325405:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449600 00000100:00100000:2.0:1787395171.325524:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449600 00000100:00100000:2.0:1787395171.325564:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395171.325571:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1874219323449600:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787395171.325596:0:14131:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:2.0:1787395171.325649:0:14131:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xedbabbe2e89a9108 00000004:00100000:2.0:1787395171.325664:0:14131:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787395171.325696:0:14131:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395171.325751:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874219323449600:12345-0@lo:38:llog_process_th.0 Request processed in 179us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.325758:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787395171.325883:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa50a80 x1874219323449600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787395181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395171.325894:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787395171.325902:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787395171.325909:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787395171.325913:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787395171.325915:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b33f92e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787395171.325922:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1874219323449600:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787395171.332146:0:14788:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787395171.332256:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787395171.332262:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787395171.332265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787395171.332277:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787395171.332354:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323449728:0@lo:400:kworker.0 00000100:00100000:2.0:1787395171.332614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395171.332668:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449728 00000100:00100000:2.0:1787395171.332681:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449728 00000100:00100000:2.0:1787395171.332722:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787395171.332730:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323449728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395171.332785:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323449728:12345-0@lo:400:kworker.0 Request processed in 55us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.332793:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787395171.332833:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33677d500 x1874219323449728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395171.332846:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323449728:0@lo:400:kworker.0 00000040:00080000:0.0:1787395171.335697:0:14788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787395171.335916:0:14765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787395171.336056:0:14765:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787395171.336120:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90f3 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395171.336132:0:14765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339129000/0xedbabbe2e89a90ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a90f3 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787395171.336190:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787395171.336192:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787395171.336193:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787395171.336194:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787395171.336196:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787395171.336197:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787395171.336198:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787395171.336200:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787395171.336201:0:14765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787395171.336215:0:14765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787395171.336218:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787395171.336219:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787395171.336220:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787395171.336221:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787395171.336222:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787395171.336223:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787395171.336224:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787395171.336225:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787395171.336226:0:14765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787395171.336250:0:14765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787395171.336270:0:14765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787395171.336359:0:14765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395171.336407:0:14765:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b34111f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395171.336509:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449856 00000100:00100000:0.0:1787395171.336516:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449856 00000100:00100000:0.0:1787395171.336555:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787395171.336563:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14765:x1874219323449856:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787395171.336588:0:14124:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787395171.336601:0:14124:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787395171.418830:0:14124:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787395171.418852:0:14124:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787395171.419162:0:14147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787395171.419168:0:14147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787395171.419191:0:14147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.419219:0:14147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.419228:0:14147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.419270:0:14147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395171.419283:0:14147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 16 pid: 14126 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395171.419341:0:14147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323449984:0@lo:104: 00000100:00100000:1.0:1787395171.419412:0:14147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395171.419448:0:14147:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f8f69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395171.419677:0:14115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323449984 00000100:00100000:2.0:1787395171.419685:0:14115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323449984 00000100:00100000:2.0:1787395171.419731:0:14115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395171.419740:0:14115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323449984:12345-0@lo:104: 00010000:00010000:2.0:1787395171.419753:0:14115:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419821:0:14115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787395171.419827:0:14115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323449984:12345-0@lo:104: Request processed in 88us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.419835:0:14115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1787395171.419855:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395171.419861:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419869:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:2.0:1787395171.419873:0:14119:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419892:0:14119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787395171.419898:0:14119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395171.419904:0:14119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787395171.419946:0:14119:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419953:0:14119:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787395171.419972:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419980:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9075 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a907c expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.419998:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395171.420000:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395171.420002:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395171.420012:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323450112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787395171.420037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395171.420077:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450112 00000100:00100000:2.0:1787395171.420221:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450112 00010000:00010000:2.0:1787395171.420239:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 17 pid: 14126 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395171.420262:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395171.420268:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:3306:x1874219323450112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395171.420283:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395171.420289:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 17 pid: 14126 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420298:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 17 pid: 14126 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420348:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420357:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787395171.420380:0:14118:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001213030s 00010000:00010000:2.0:1787395171.420385:0:14118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420393:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420400:0:14118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420406:0:14118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420412:0:14118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395171.420417:0:14118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420424:0:14118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420440:0:14118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420450:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395171.420481:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:3306:x1874219323450112:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395171.420489:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395171.420702:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323450112:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395171.420733:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b33f55ce00/0xedbabbe2e89a907c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9075 expref: 16 pid: 14126 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395171.420743:0:14147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323449984:0@lo:104: 00010000:00010000:2.0:1787395171.420756:0:14147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420765:0:14147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420771:0:14147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395171.420777:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a910f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395171.438763:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14765:x1874219323449856:12345-0@lo:253:mount.lustre.0 Request processed in 102191us (102394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395171.438795:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787395171.438837:0:14765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14765:1874219323449856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787395171.438852:0:14765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787395171.438855:0:14765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787395171.438857:0:14765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787395171.438858:0:14765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787395171.438859:0:14765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787395171.438861:0:14765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787395171.438862:0:14765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787395171.438863:0:14765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787395171.438865:0:14765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787395171.438866:0:14765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787395171.438881:0:14765:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787395171.443005:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395171.443188:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787395171.443521:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395171.443694:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787395171.443848:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395171.444026:0:14765:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787395171.444862:0:14765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787395171.490127:0:14765:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787395171.490137:0:14765:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787395171.490170:0:14765:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787395171.490449:0:14765:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787395171.490465:0:14765:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787395171.490498:0:14765:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787395172.309839:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395173.330605:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787395173.462034:0:14128:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787395173.462040:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b336008000 from 7 10000000:01000000:3.0:1787395173.462044:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787395173.462083:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395173.462095:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395173.462106:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395173.462128:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323450240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787395173.462186:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395173.462232:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395173.462277:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450240 00000100:00100000:1.0:1787395173.462283:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450240 00000100:00100000:1.0:1787395173.462351:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787395173.462370:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+15:14128:x1874219323450240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395173.462383:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395173.462396:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9116 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395173.462434:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395173.462443:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 16 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395173.462452:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129e00, rc 0) 00000100:00100000:1.0:1787395173.462488:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14128:x1874219323450240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395173.462495:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787395173.462570:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323450240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395173.462582:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395173.462591:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395173.462642:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323450368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787395173.462667:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395173.462686:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:1.0:1787395173.462720:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450368 00000100:00100000:1.0:1787395173.462724:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450368 00000100:00100000:1.0:1787395173.462749:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787395173.462755:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14128:x1874219323450368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787395173.462766:0:14124:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787395173.462781:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787395173.462785:0:14124:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787395173.462860:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14128:x1874219323450368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395173.462866:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787395173.462891:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323450368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787395173.462937:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787395173.462943:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395173.462951:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395174.354651:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395175.395092:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395176.402599:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787395176.530549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395176.530558:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787395176.530561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395176.530563:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787395176.530618:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323450496:0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.530688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395176.530738:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395176.530744:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323450624:0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.530774:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395176.530807:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323450752:0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.530827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395176.530857:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450496 00000100:00100000:0.0:1787395176.530863:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450496 00000100:00100000:0.0:1787395176.530904:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787395176.530912:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:3303:x1874219323450496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.530956:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:3303:x1874219323450496:12345-0@lo:400:kworker.0 Request processed in 45us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395176.530991:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787395176.531026:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450624 00000100:00100000:0.0:1787395176.531029:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450624 00000100:00100000:0.0:1787395176.531050:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450752 00000100:00100000:0.0:1787395176.531053:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450752 00000100:00100000:0.0:1787395176.531074:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787395176.531080:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323450624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.531111:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323450624:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395176.531117:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787395176.531129:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787395176.531135:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323450752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.531164:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323450752:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395176.531170:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787395176.531219:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa50700 x1874219323450752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395176.531233:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323450752:0@lo:400:kworker.0 00010000:00080000:0.0:1787395176.531260:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa52680 x1874219323450624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395176.531269:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323450624:0@lo:400:kworker.0 00000100:00100000:0.0:1787395176.531278:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323450496:0@lo:400:kworker.0 00000100:00080000:1.0:1787395176.531576:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787395177.428006:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787395177.487617:0:15132:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787395178.452070:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395178.770882:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787395179.478278:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395180.499467:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395181.535762:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395181.586577:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395166/real 1787395166] req@ffffa0b32fa50380 x1874219323446656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395181.586613:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b32fa50380 x1874219323446656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395181.586624:0:3302:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787395166/real 1787395166] req@ffffa0b32fa50e00 x1874219323446784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395181 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395181.586636:0:3302:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa0b32fa50e00 x1874219323446784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787395181 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787395181.586656:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b305248800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787395181.586684:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787395181.586688:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323446656:0@lo:8:kworker.0 00000100:00080000:0.0:1787395181.586695:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787395181.586700:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787395181.586703:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323446784:0@lo:8:kworker.0 00000100:00080000:1.0:1787395181.586845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787395181.586849:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787395181.586852:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0b305248800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787395181.586857:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:1.0:1787395181.586862:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787395181.586869:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa0b305248800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787395181.586889:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b327e77480 x1874219323451008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787395181.586915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787395181.586918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787395181.586919:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787395181.586922:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:1.0:1787395181.586924:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787395181.586928:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b30524b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1787395181.586941:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b327e77800 x1874219323451136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787395181.586987:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323451264:0@lo:400:kworker.0 00000100:00100000:1.0:1787395181.587046:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395181.587091:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395181.587110:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323451392:0@lo:400:kworker.0 00000100:00100000:1.0:1787395181.587136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395181.587186:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451264 00000100:00100000:1.0:1787395181.587193:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451264 00000100:00100000:1.0:1787395181.587244:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451392 00000100:00100000:1.0:1787395181.587248:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451392 00000100:00100000:1.0:1787395181.587275:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787395181.587283:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323451264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395181.587555:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323451264:12345-0@lo:400:kworker.0 Request processed in 271us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395181.587563:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787395181.587584:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787395181.587591:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323451392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395181.587619:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323451392:12345-0@lo:400:kworker.0 Request processed in 29us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395181.587626:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787395181.587648:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395181.587659:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323451008:0@lo:8:kworker.0 00000100:00100000:1.0:1787395181.587689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395181.587710:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323451136:0@lo:8:kworker.0 00000100:00100000:1.0:1787395181.587733:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787395181.587778:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b327e75180 x1874219323451392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395181.587790:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323451392:0@lo:400:kworker.0 00010000:00080000:1.0:1787395181.587801:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b327e77b80 x1874219323451264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787395181.587808:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323451264:0@lo:400:kworker.0 00000100:00100000:0.0:1787395181.588018:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323450880:0@lo:400:kworker.0 00000100:00100000:0.0:1787395181.588047:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395181.588215:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323450880 00000100:00100000:1.0:1787395181.588220:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323450880 00000100:00100000:3.0:1787395181.588384:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451008 00000100:00100000:3.0:1787395181.588389:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451008 00000100:00100000:3.0:1787395181.588406:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451136 00000100:00100000:3.0:1787395181.588409:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451136 00000100:00100000:3.0:1787395181.588419:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787395181.588424:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323451008:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787395181.588449:0:14766:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 453 last 0 00000020:00000080:3.0:1787395181.588479:0:14766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a9124 00002000:00100000:3.0:1787395181.588492:0:14766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa0b318a8d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787395181.588496:0:14766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787395181.588499:0:14766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787395181.588823:0:14766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787395181.588843:0:14766:0:(import.c:65:import_set_state_nolock()) ffffa0b318a8b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787395181.588888:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874219323451008:12345-0@lo:8:kworker.0 Request processed in 462us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395181.588895:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787395181.588922:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787395181.588927:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323451136:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787395181.588937:0:14766:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787395181.588959:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323451136:12345-0@lo:8:kworker.0 Request processed in 31us (1225us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787395181.588972:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787395181.589579:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787395181.589593:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:3306:x1874219323450880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395181.589644:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:3306:x1874219323450880:12345-0@lo:400:kworker.0 Request processed in 57us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395181.589650:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787395181.589740:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323450880:0@lo:400:kworker.0 00010000:00080000:0.0:1787395181.593510:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b327e77480 x1874219323451008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787395201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395181.593525:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787395181.593535:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787395181.593544:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787395181.593550:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787395181.593554:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b305248800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787395181.593578:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787395181.593596:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323451008:0@lo:8:kworker.0 00000100:00080000:0.0:1787395181.593615:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787395181.593619:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787395181.593622:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323451136:0@lo:8:kworker.0 00000004:00080000:3.0:1787395181.593894:0:14154:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787395181.593927:0:14154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14154:1874219323451648:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787395181.593985:0:14154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395181.594009:0:14154:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30873d480 going to sleep for 11 seconds 00000004:00080000:3.0:1787395181.594023:0:14153:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787395181.594557:0:14153:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 453543249055ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787395181.594588:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451648 00000100:00100000:3.0:1787395181.594595:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451648 00000100:00100000:3.0:1787395181.594653:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787395181.594662:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14154:x1874219323451648:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787395181.595494:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323451520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395181.595549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395181.595617:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451520 00000100:00100000:0.0:1787395181.595622:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451520 00000100:00100000:0.0:1787395181.595657:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395181.595664:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323451520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395181.595691:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395181.595735:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323451520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395181.595742:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787395181.595778:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33676b100 x1874219323451520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395181.595797:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323451520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787395181.597500:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1787395181.600099:0:14766:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787395181.600110:0:14766:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787395181.600115:0:14766:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1787395181.631817:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.631829:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.631846:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.631850:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.631856:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.631872:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.631882:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.631890:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.631910:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395181.633496:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.633508:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633524:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.633537:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.633543:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633556:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633565:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633572:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633588:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787395181.633980:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.633986:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.633996:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.633999:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.634004:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.634014:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.634022:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.634036:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.634045:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787395181.634840:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787395181.634849:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634859:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.634864:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634873:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634909:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634918:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a912b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634941:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395181.634944:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634951:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.634954:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634962:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634972:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634979:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a9132 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.634991:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.634994:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.635007:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.635010:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.635018:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.635028:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.635035:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a9139 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.635049:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.635051:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.635052:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.635430:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395181.636863:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.636874:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.636891:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.636895:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.636901:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.636928:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.636939:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.636947:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.636966:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395181.637720:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.637789:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637800:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.637805:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637814:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637834:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637841:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9140 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637865:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.637867:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.637869:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395181.637893:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.637899:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637908:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.637911:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.637917:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637926:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637933:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637941:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.637955:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395181.639798:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.639810:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.639834:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ca00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.639839:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.639849:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.639867:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.639874:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a9147 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.639892:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.639894:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.639896:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395181.641073:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.641084:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.641113:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.641116:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.641122:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.641135:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.641150:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.641157:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.642600:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787395181.643173:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.643181:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.643198:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.643201:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.643208:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.643222:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.643230:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.643238:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644576:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787395181.644587:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644599:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.644604:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644614:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644636:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644643:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a914e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644662:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395181.644666:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644689:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.644692:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644701:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644713:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.644721:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.644722:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.644724:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.644934:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787395181.644941:0:14766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a9155 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.644997:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.662513:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.662526:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.662545:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.662550:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.662557:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.662571:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.662580:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.662588:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.662604:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395181.662981:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395181.662989:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.662998:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48c00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.663003:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.663012:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.663029:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.663044:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a245363/0xedbabbe2e89a915c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.663061:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.663063:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.663065:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.663541:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.663556:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.663566:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.663570:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.663575:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.663585:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.663594:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.663601:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.663619:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395181.664333:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.664341:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664353:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.664356:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.664360:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664369:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664383:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664389:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664399:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787395181.664547:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395181.664554:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664563:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.664567:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664576:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664591:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664599:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000323f74a7/0xedbabbe2e89a9163 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664615:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.664618:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664635:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.664638:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664645:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664657:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664664:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052fb00bf/0xedbabbe2e89a916a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.664676:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.664678:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.664680:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.664973:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.664980:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.664988:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.664991:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.664996:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665004:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665011:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665018:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665050:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395181.665578:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.665584:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.665592:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.665596:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.665603:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.665625:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.665632:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fc9c166/0xedbabbe2e89a9171 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.665647:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.665649:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.665651:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.665897:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.665903:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665912:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.665916:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.665920:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665929:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665938:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665945:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.665967:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395181.666269:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.666274:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.666282:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.666286:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.666295:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.666340:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.666348:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a9178 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.666375:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.666377:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.666379:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.670997:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.672803:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.672824:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.672843:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.672857:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.672864:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.672879:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.672890:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.672898:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.672915:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787395181.674503:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.674512:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.674525:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.674529:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.674539:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.674559:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.674566:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007249a606/0xedbabbe2e89a917f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.674587:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.674589:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.674591:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.674710:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.674717:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.675216:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.675223:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.675230:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.675244:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.675253:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.675267:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.676036:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395181.676864:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.676873:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.676887:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.676890:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.676896:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.676908:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.676916:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.676924:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.680979:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395181.680993:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681025:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.681030:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681041:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681063:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681071:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b58c81b/0xedbabbe2e89a9186 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681111:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.681115:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681121:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.681124:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681131:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681141:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.681155:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.681156:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.681158:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395181.684366:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787395181.684383:0:14766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068876238/0xedbabbe2e89a918d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395181.685719:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.685887:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.685905:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.685910:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.685917:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.685932:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.685941:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.685950:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.686438:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395181.686953:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.686960:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.686971:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.686975:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.686987:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.686998:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.687006:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.687012:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.687020:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787395181.692959:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.692987:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.693007:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.693011:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.693018:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.693033:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.693045:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.693081:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.693104:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787395181.694091:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787395181.694100:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694112:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.694117:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694126:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694144:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694153:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005852e6ef/0xedbabbe2e89a9194 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694173:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395181.694177:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694184:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.694194:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694202:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694214:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694221:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a874f1f/0xedbabbe2e89a919b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694235:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.694238:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694244:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.694247:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694254:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694264:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694272:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000098d50fe/0xedbabbe2e89a91a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.694292:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.694294:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.694295:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.694324:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395181.695409:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.695421:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.695437:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.695441:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.695447:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.695459:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.695469:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.695476:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.695533:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395181.696076:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395181.696082:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.696109:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=453s v=(0 0) 00010000:00010000:2.0:1787395181.696112:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395181.696117:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.696126:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.696135:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395181.696142:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697538:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395181.697551:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697564:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.697569:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697580:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697598:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697606:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5c5bc81/0xedbabbe2e89a91a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697626:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395181.697629:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697635:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:3.0:1787395181.697650:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697659:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697670:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.697678:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.697679:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.697681:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395181.697760:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787395181.697766:0:14766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d519c36/0xedbabbe2e89a91b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.698279:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395181.709526:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.709546:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.709565:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.709570:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.709576:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.709590:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.709601:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.709622:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.710582:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787395181.711271:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.711279:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.711686:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.711691:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.711697:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.711711:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.711720:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.712532:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712600:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787395181.712608:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712617:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.712622:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712631:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712650:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712658:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083c37796/0xedbabbe2e89a91b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712678:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395181.712681:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712701:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ca00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.712704:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712711:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712721:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.712738:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.712739:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.712741:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395181.715753:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787395181.715769:0:14766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a15bfdd3/0xedbabbe2e89a91be lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787395181.716635:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.716644:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.716657:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.716661:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.716667:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.716680:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.716690:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.716698:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.716714:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787395181.717121:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.717128:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717137:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.717140:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.717151:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717160:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717168:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717175:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717184:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787395181.717621:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.717627:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717635:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.717638:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.717642:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717651:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717658:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717676:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.717685:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787395181.718082:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.718089:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718097:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.718100:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.718105:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718114:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718122:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718129:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718137:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787395181.718565:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395181.718572:0:14766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718587:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=453s v=(0 0) 00010000:00010000:3.0:1787395181.718590:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395181.718594:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718604:0:14766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718612:0:14766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718619:0:14766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395181.718628:0:14766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:3.0:1787395181.718808:0:14766:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1787395181.718909:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14154:x1874219323451648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 124242us (124918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395181.718918:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787395181.718978:0:14154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14154:1874219323451648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787395181.718994:0:14154:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787395181.719038:0:14154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14154:1874219323451776:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787395181.719071:0:14154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395181.719112:0:14154:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c25780 going to sleep for 11 seconds 00000100:00100000:3.0:1787395181.719136:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451776 00000100:00100000:3.0:1787395181.719142:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451776 00000100:00100000:3.0:1787395181.719191:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395181.719199:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14154:x1874219323451776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787395181.719234:0:14769:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1787395181.720356:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787395181.720368:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720379:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.720385:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720396:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720417:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720441:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a91c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720463:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787395181.720467:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720474:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55de00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.720476:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720483:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720493:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720499:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9a0884f/0xedbabbe2e89a91cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720509:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787395181.720512:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720517:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.720526:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720533:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720542:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720549:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe5f4101/0xedbabbe2e89a91d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720562:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787395181.720565:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720571:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.720575:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720582:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720591:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720597:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a91da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720617:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395181.720621:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720628:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395181.720631:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720639:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720649:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720655:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cdb3f21/0xedbabbe2e89a91e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395181.720667:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.720669:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395181.720671:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395181.720969:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787395181.722087:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787395181.740192:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14154:x1874219323451776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20983us (21109us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787395181.740206:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395181.740271:0:14154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14154:1874219323451776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787395181.740286:0:14154:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:3.0:1787395181.768603:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787395182.547853:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395183.574026:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787395183.942435:0:15436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787395183.942439:0:15436:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787395183.942584:0:15436:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa0b33f928800 00000020:01000004:1.0:1787395183.942599:0:15436:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787395183.942611:0:15436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787395183.942624:0:15436:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa0b305ceb380) 00000020:00000080:1.0:1787395183.942639:0:15436:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787395183.992699:0:15436:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787395183.993108:0:15436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787395183.995535:0:15436:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787395183.996257:0:15436:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787395183.996536:0:15436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787395184.006398:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 425: rc = 0 00100000:10000000:2.0:1787395184.006508:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 425: rc = 0 00100000:10000000:2.0:1787395184.006600:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 425: rc = 0 00100000:10000000:2.0:1787395184.010033:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787395184.010358:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1787395184.010596:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1787395184.010833:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1787395184.011069:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1787395184.011353:0:15436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1787395184.017737:0:15436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787395184.017751:0:15436:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787395184.017763:0:15436:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedbabbe2e89a91ef 00000020:01000004:2.0:1787395184.017771:0:15436:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787395184.017792:0:15436:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787395184.017796:0:15436:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787395184.017803:0:15436:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787395184.018378:0:15436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787395184.018384:0:15436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787395184.040794:0:15436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787395184.041210:0:15436:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.116@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787395184.041215:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787395184.041217:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787395184.041219:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787395184.041220:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787395184.041221:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787395184.041223:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787395184.041224:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787395184.041225:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787395184.041227:0:15436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787395184.041231:0:15436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787395184.041233:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787395184.041235:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787395184.041236:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787395184.041237:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787395184.041238:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787395184.041239:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787395184.041240:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787395184.041241:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787395184.041242:0:15436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787395184.041267:0:15436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787395184.041297:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323451904:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787395184.041400:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.041508:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33674e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.042001:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323451904 00000100:00100000:0.0:1787395184.042009:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323451904 00000100:00100000:0.0:1787395184.042108:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787395184.042126:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:15436:x1874219323451904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787395184.042157:0:14126:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787395184.042160:0:14126:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787395184.042171:0:14126:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787395184.054927:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:15436:x1874219323451904:12345-0@lo:253:mount.lustre.0 Request processed in 12800us (13516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395184.054942:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787395184.055094:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323451904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787395184.055108:0:15436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787395184.055112:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787395184.055114:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787395184.055115:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787395184.055116:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787395184.055192:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787395184.055193:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787395184.055195:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787395184.055197:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787395184.055198:0:15436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787395184.055221:0:15436:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa0b33f928800 from lustre-OST0001 10000000:01000000:2.0:1787395184.055247:0:15436:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787395184.055250:0:15436:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787395184.055257:0:15436:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa0b33f93b380 local copy 00010000:00010000:2.0:1787395184.055267:0:15436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.055526:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395184.055566:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.055610:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787395184.055675:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452032 00000100:00100000:1.0:1787395184.055681:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452032 00000100:00100000:1.0:1787395184.055727:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787395184.055736:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:15436:x1874219323452032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395184.056086:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:15436:x1874219323452032:12345-0@lo:501:mount.lustre.0 Request processed in 351us (518us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787395184.056094:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787395184.056335:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452032:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787395184.056350:0:15436:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787395184.056487:0:15436:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787395184.056494:0:15436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.056504:0:15436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339128000/0xedbabbe2e89a8f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a8fa3 expref: -99 pid: 14113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395184.056541:0:15436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa0b33f928800 10000000:01000000:2.0:1787395184.056546:0:15436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787395184.056551:0:15436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787395184.056555:0:15436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787395184.056559:0:15436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787395184.056562:0:15436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787395184.056586:0:15436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.056594:0:15436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.056602:0:15436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.056616:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787395184.056642:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.056665:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1300 going to sleep for 11 seconds 00000100:00100000:1.0:1787395184.056727:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452160 00000100:00100000:1.0:1787395184.056732:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452160 00000100:00100000:1.0:1787395184.056764:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787395184.056961:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:15436:x1874219323452160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787395184.056974:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395184.056987:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a91fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a91f6 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.057006:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a91fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a91f6 expref: 17 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.057016:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339128400/0xedbabbe2e89a91fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a91f6 expref: 17 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.057024:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128400, rc 0) 00000100:00100000:1.0:1787395184.057061:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452160:12345-0@lo:101:mount.lustre.0 Request processed in 291us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395184.057067:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787395184.057150:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395184.057164:0:15436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a91fd expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.057172:0:15436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a91fd expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787395184.062858:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787395184.063900:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787395184.064148:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787395184.064194:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787395184.064226:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787395184.064271:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787395184.064371:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787395184.064412:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787395184.064508:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787395184.064518:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787395184.064595:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787395184.064667:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395184.064710:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395184.065462:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452288 00000100:00100000:1.0:1787395184.065471:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452288 00000100:00100000:1.0:1787395184.065530:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787395184.065539:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787395184.065879:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452288:12345-0@lo:501:mount.lustre.0 Request processed in 340us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395184.065887:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787395184.066028:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395184.066064:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395184.066105:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395184.066142:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395184.066920:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452416 00000100:00100000:1.0:1787395184.066927:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452416 00000100:00100000:1.0:1787395184.066968:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787395184.066978:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787395184.067742:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452416:12345-0@lo:503:mount.lustre.0 Request processed in 765us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395184.067750:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787395184.075045:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787395184.085733:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787395184.086470:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787395184.086552:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395184.086628:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c25000 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.093885:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452544 00000100:00100000:0.0:1787395184.093902:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452544 00000100:00100000:0.0:1787395184.093969:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787395184.093978:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787395184.094326:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452544:12345-0@lo:502:mount.lustre.0 Request processed in 348us (7773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.094334:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787395184.094535:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395184.094832:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787395184.094892:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787395184.094929:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787395184.094980:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787395184.095031:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787395184.095068:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787395184.095119:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787395184.095158:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787395184.095208:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787395184.095246:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787395184.095302:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395184.095356:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.095909:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452672 00000100:00100000:2.0:1787395184.095916:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452672 00000100:00100000:2.0:1787395184.095962:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787395184.095978:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395184.096155:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452672:12345-0@lo:502:mount.lustre.0 Request processed in 177us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.096163:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787395184.096571:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395184.096652:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787395184.096663:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787395184.099909:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787395184.099931:0:15437:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787395184.099938:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787395184.099940:0:15437:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787395184.099947:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787395184.099962:0:15437:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa0b3411d0000) 00000020:00000080:3.0:1787395184.099986:0:15437:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787395184.099992:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787395184.100054:0:15437:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b33f928800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787395184.100072:0:15437:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787395184.100080:0:15437:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xedbabbe2e89a920b 00010000:00010000:3.0:1787395184.103141:0:15437:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787395184.116483:0:15437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787395184.119489:0:15437:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787395184.123077:0:15437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787395184.123089:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787395184.123095:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395184.123098:0:15437:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787395184.123102:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787395184.123105:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395184.123107:0:15437:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787395184.123110:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787395184.123112:0:15437:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787395184.123114:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787395184.123126:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395184.123128:0:15437:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787395184.123130:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787395184.123133:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395184.123135:0:15437:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787395184.123138:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787395184.123204:0:15437:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787395184.123208:0:15437:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787395184.123209:0:15437:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787395184.123213:0:15437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787395184.130107:0:15436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787395184.130168:0:15436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787395184.130194:0:15436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a91fd expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.130206:0:15436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48600/0xedbabbe2e89a91f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a91fd expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395184.130215:0:15436:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f928800 from 1 10000000:01000000:2.0:1787395184.130217:0:15436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787395184.130259:0:15436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.130267:0:15436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.130279:0:15436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.130331:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452800:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787395184.130396:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.130439:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.130624:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452800 00000100:00100000:0.0:1787395184.130633:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452800 00000100:00100000:0.0:1787395184.130677:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787395184.130687:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3395a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:15436:x1874219323452800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787395184.130700:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395184.130714:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9212 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395184.130738:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395184.130748:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395184.130758:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010200, rc 0) 00000100:00100000:0.0:1787395184.130820:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3395a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323452800:12345-0@lo:101:mount.lustre.0 Request processed in 126us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.130828:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787395184.131019:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452800:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395184.131033:0:15436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.131057:0:15436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395184.134426:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787395184.134791:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787395184.139556:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787395184.139617:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787395184.139674:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787395184.139683:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787395184.139775:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395184.144946:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.144996:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.145181:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323452928 00000100:00100000:0.0:1787395184.145190:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323452928 00000100:00100000:0.0:1787395184.145244:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787395184.145254:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3395a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323452928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395184.145541:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3395a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323452928:12345-0@lo:501:mount.lustre.0 Request processed in 287us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.145549:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787395184.146232:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323452928:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395184.146287:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453056:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395184.146364:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.146391:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.147113:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453056 00000100:00100000:0.0:1787395184.147131:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453056 00000100:00100000:0.0:1787395184.147174:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787395184.147182:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3395a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787395184.147439:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3395a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453056:12345-0@lo:503:mount.lustre.0 Request processed in 256us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.147446:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787395184.148064:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453056:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787395184.148557:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787395184.148615:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453184:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395184.148657:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.148685:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453184 00000100:00100000:2.0:1787395184.148690:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453184 00000100:00100000:2.0:1787395184.148715:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787395184.148722:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787395184.149390:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.150299:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453184:12345-0@lo:502:mount.lustre.0 Request processed in 1575us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.150335:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787395184.150792:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787395184.151030:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787395184.151078:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787395184.151145:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787395184.151186:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787395184.151223:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787395184.151277:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787395184.151354:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787395184.151393:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787395184.151422:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787395184.151469:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395184.151495:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f9140c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.151764:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453312 00000100:00100000:2.0:1787395184.151861:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453312 00000100:00100000:2.0:1787395184.151899:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787395184.151906:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395184.153357:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453312:12345-0@lo:502:mount.lustre.0 Request processed in 1446us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.153369:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787395184.158001:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787395184.158482:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787395184.158501:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787395184.159747:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395184.159759:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159761:0:15441:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787395184.159784:0:15441:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b33f928800 00000020:00000080:1.0:1787395184.159787:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787395184.159794:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395184.159797:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159799:0:15441:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787395184.159801:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395184.159827:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159828:0:15441:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787395184.159833:0:15441:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa0b33f928800 00000020:00000080:1.0:1787395184.159835:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787395184.159894:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395184.159897:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159899:0:15441:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787395184.159902:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787395184.159904:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159905:0:15441:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787395184.159908:0:15441:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa0b33f928800 00000020:00000080:1.0:1787395184.159911:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787395184.159954:0:15441:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787395184.159958:0:15441:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787395184.159959:0:15441:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787395184.159962:0:15441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787395184.161936:0:15436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787395184.161968:0:15436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787395184.161982:0:15436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.161995:0:15436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395184.162048:0:15436:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787395184.162051:0:15436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa0b33f928800 10000000:01000000:2.0:1787395184.162055:0:15436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa0b33f928800 10000000:01000000:2.0:1787395184.162065:0:15436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787395184.162071:0:15436:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa0b33f928800 from 1 10000000:01000000:2.0:1787395184.162074:0:15436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787395184.162107:0:15436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.162115:0:15436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.162144:0:15436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.162169:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453440:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787395184.162232:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.162277:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1787395184.162426:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453440 00000100:00100000:3.0:1787395184.162434:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453440 00000100:00100000:3.0:1787395184.162485:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787395184.162493:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323453440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787395184.162506:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395184.162518:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55ca00/0xedbabbe2e89a9227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a9220 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.162539:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55ca00/0xedbabbe2e89a9227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a9220 expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.162549:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55ca00/0xedbabbe2e89a9227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9220 expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.162557:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ca00, rc 0) 00000100:00100000:3.0:1787395184.162594:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453440:12345-0@lo:101:mount.lustre.0 Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395184.162600:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787395184.164085:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453440:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787395184.164104:0:15436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9227 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.164115:0:15436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a9227 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395184.164657:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787395184.164912:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787395184.165135:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787395184.165171:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787395184.165197:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787395184.165248:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787395184.165277:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787395184.165349:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787395184.165379:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787395184.165405:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787395184.165441:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787395184.165469:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787395184.165495:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787395184.165531:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787395184.165559:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787395184.165585:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787395184.165632:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787395184.165659:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787395184.165685:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787395184.165720:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787395184.165747:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787395184.165786:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787395184.165824:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787395184.165851:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787395184.165877:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787395184.165912:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787395184.165944:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787395184.165970:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787395184.166018:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787395184.166049:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787395184.166075:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787395184.166110:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787395184.166138:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787395184.166163:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787395184.166188:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787395184.166225:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787395184.166252:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787395184.166343:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787395184.166381:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787395184.166453:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787395184.166462:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787395184.166532:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395184.166586:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.166628:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395184.166867:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453568 00000100:00100000:0.0:1787395184.166874:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453568 00000100:00100000:0.0:1787395184.166918:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787395184.166927:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787395184.167732:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453568:12345-0@lo:501:mount.lustre.0 Request processed in 805us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.167741:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787395184.183481:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787395184.183547:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395184.183634:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.183672:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453696 00000100:00100000:2.0:1787395184.183679:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453696 00000100:00100000:2.0:1787395184.183726:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787395184.183736:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453696:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787395184.191371:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453696:12345-0@lo:503:mount.lustre.0 Request processed in 7626us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.191384:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787395184.191471:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1900 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.191493:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453696:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787395184.192595:0:15436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787395184.192672:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453824:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395184.192728:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.192758:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3081fccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.192796:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453824 00000100:00100000:2.0:1787395184.192802:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453824 00000100:00100000:2.0:1787395184.195262:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787395184.195274:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787395184.195612:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453824:12345-0@lo:502:mount.lustre.0 Request processed in 339us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.195620:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787395184.195705:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787395184.200099:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787395184.206418:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787395184.206474:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787395184.206550:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787395184.206590:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787395184.206634:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787395184.206663:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787395184.206690:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787395184.206728:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787395184.206760:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787395184.206818:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787395184.206869:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787395184.206897:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787395184.206923:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787395184.206959:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787395184.206986:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787395184.207012:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787395184.207049:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787395184.207079:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787395184.207111:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787395184.207165:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787395184.207193:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787395184.207219:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787395184.207272:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787395184.207347:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787395184.207383:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787395184.207449:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787395184.207486:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787395184.207521:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787395184.207572:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787395184.207605:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787395184.207631:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787395184.207657:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787395184.207695:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787395184.207722:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787395184.207758:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787395184.207785:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787395184.207811:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787395184.207858:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787395184.207895:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787395184.207944:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787395184.208019:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395184.208075:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323453952 00000100:00100000:3.0:1787395184.208088:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323453952 00000100:00100000:3.0:1787395184.208130:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787395184.208138:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787395184.208364:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323453952:12345-0@lo:502:mount.lustre.0 Request processed in 225us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395184.208372:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787395184.208420:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318d18e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787395184.208441:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323453952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787395184.208496:0:15436:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787395184.208503:0:15436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787395184.227636:0:15446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787395184.227651:0:15446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa0b318dbcd40) 00000020:00000080:2.0:1787395184.227673:0:15446:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787395184.227844:0:15446:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa0b33f928800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787395184.227849:0:15446:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa0b33f928800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787395184.227852:0:15446:0:(obd_mount.c:710:lustre_put_lsi()) put ffffa0b33f928800 3 00010000:00080000:2.0:1787395184.227882:0:15446:0:(ldlm_lib.c:102:import_set_conn()) imp ffffa0b327f7e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1787395184.229445:0:15446:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787395184.229538:0:15446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787395184.229566:0:15446:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787395184.229576:0:15446:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xedbabbe2e89a9235 00000100:00080000:2.0:1787395184.229585:0:15446:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787395184.229590:0:15446:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa0b327f7e000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1787395184.229622:0:15446:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b33677f800 x1874219323454080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787395184.229643:0:15446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1787395184.229878:0:15446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787395184.229975:0:15436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787395184.229998:0:15436:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787395184.230013:0:15436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9227 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.230023:0:15436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49600/0xedbabbe2e89a9220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9227 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787395184.230062:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787395184.230065:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787395184.230066:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787395184.230068:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787395184.230069:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787395184.230070:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787395184.230072:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787395184.230074:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787395184.230075:0:15436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787395184.230082:0:15436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787395184.230085:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787395184.230086:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787395184.230086:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787395184.230087:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787395184.230088:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787395184.230089:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787395184.230101:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787395184.230103:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787395184.230104:0:15436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787395184.230119:0:15436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787395184.230133:0:15436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323454208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787395184.230196:0:15436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395184.230227:0:15436:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b3085d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1787395184.230247:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454208 00000100:00100000:2.0:1787395184.230252:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454208 00000100:00100000:0.0:1787395184.232177:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323454080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787395184.232237:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787395184.232341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395184.232346:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787395184.232349:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787395184.232353:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:0.0:1787395184.232358:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787395184.232363:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b30524b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395184.232381:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa50700 x1874219323454464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787395184.232438:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454080 00000100:00100000:0.0:1787395184.232443:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454080 00000100:00100000:0.0:1787395184.232480:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787395184.232487:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1874219323454080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787395184.232511:0:14132:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:0.0:1787395184.232544:0:14132:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xedbabbe2e89a923c 00000004:00100000:0.0:1787395184.232558:0:14132:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787395184.232599:0:14132:0:(import.c:65:import_set_state_nolock()) ffffa0b33f92a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787395184.232641:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874219323454080:12345-0@lo:38:llog_process_th.0 Request processed in 154us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.232648:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787395184.232673:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323454336:0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.232699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395184.232731:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323454592:0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.232752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395184.232767:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395184.232781:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323454720:0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.232803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395184.232828:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454592 00000100:00100000:0.0:1787395184.232831:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454592 00000100:00100000:0.0:1787395184.232852:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454720 00000100:00100000:0.0:1787395184.232854:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454720 00000100:00100000:0.0:1787395184.232877:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787395184.232883:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323454592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.232926:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874219323454592:12345-0@lo:400:kworker.0 Request processed in 42us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.232932:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787395184.232944:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787395184.232950:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323454720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.232977:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874219323454720:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.232982:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787395184.233006:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454336 00000100:00100000:0.0:1787395184.233010:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454336 00000100:00100000:0.0:1787395184.233036:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395184.233042:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323454336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.233074:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323454336:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395184.233079:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787395184.233097:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787395184.233101:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395184.233128:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323454336:0@lo:400:kworker.0 00010000:00080000:0.0:1787395184.233155:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa51500 x1874219323454720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395184.233170:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1874219323454720:0@lo:400:kworker.0 00010000:00080000:0.0:1787395184.233181:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b32fa50380 x1874219323454592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395184.233189:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874219323454592:0@lo:400:kworker.0 00000100:00100000:0.0:1787395184.233207:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323454464:0@lo:8:kworker.0 00000100:00100000:0.0:1787395184.233229:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787395184.233253:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa0b33677f800 x1874219323454080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787395194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395184.233261:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787395184.233266:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787395184.233273:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787395184.233278:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787395184.233290:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787395184.233296:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1874219323454080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787395184.233513:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787395184.233524:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:15436:x1874219323454208:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787395184.233546:0:14124:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787395184.233560:0:14124:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787395184.233977:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454464 00000100:00100000:3.0:1787395184.233983:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454464 00000100:00100000:3.0:1787395184.234005:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395184.234009:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1874219323454464:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1787395184.234053:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3302:x1874219323454464:12345-0@lo:8:kworker.0 Request processed in 42us (822us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787395184.234059:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787395184.244946:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787395184.244961:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787395184.244969:0:3302:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787395184.244973:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323454464:0@lo:8:kworker.0 20000000:01000000:3.0:1787395184.294003:0:14124:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787395184.294023:0:14124:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787395184.294072:0:14147:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787395184.294077:0:14147:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787395184.294098:0:14147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.294126:0:14147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.294135:0:14147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.294174:0:14147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.294187:0:14147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 19 pid: 14126 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395184.294220:0:14147:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323454848:0@lo:104: 00000100:00100000:1.0:1787395184.294291:0:14147:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395184.294352:0:14147:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308296900 going to sleep for 11 seconds 00000100:00100000:3.0:1787395184.294479:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454848 00000100:00100000:3.0:1787395184.294487:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454848 00000100:00100000:3.0:1787395184.294538:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395184.294546:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323454848:12345-0@lo:104: 00010000:00010000:3.0:1787395184.294557:0:14114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294612:0:14114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787395184.294618:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:14147:x1874219323454848:12345-0@lo:104: Request processed in 73us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395184.294626:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787395184.294647:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395184.294653:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294661:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395184.294665:0:14120:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294674:0:14120:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395184.294681:0:14120:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395184.294687:0:14120:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787395184.294714:0:14120:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294720:0:14120:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395184.294739:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294746:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d000/0xedbabbe2e89a9116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a911d expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395184.294771:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395184.294772:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395184.294774:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395184.294786:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3305:1874219323454976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395184.294815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395184.295040:0:14147:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14147:1874219323454848:0@lo:104: 00010000:00010000:1.0:1787395184.295063:0:14147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.295410:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323454976 00000100:00100000:2.0:1787395184.295416:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323454976 00010000:00010000:2.0:1787395184.295437:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 20 pid: 14126 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395184.295463:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787395184.295469:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+20:3305:x1874219323454976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787395184.295480:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395184.295485:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 20 pid: 14126 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295495:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 20 pid: 14126 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295508:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b339129e00/0xedbabbe2e89a911d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9116 expref: 20 pid: 14126 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295533:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295540:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787395184.295553:0:14118:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001476131s 00010000:00010000:2.0:1787395184.295557:0:14118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295564:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295571:0:14118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295578:0:14118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295584:0:14118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395184.295589:0:14118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295596:0:14118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295609:0:14118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395184.295618:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395184.295661:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3305:x1874219323454976:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395184.295668:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787395184.295698:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3305:1874219323454976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787395184.295793:0:14147:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.295801:0:14147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395184.295808:0:14147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b339129600/0xedbabbe2e89a9243 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395184.312648:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:15436:x1874219323454208:12345-0@lo:253:mount.lustre.0 Request processed in 79114us (82438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395184.312664:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787395184.312761:0:15436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd69c846-0fd6-4b2d-8c27-adaad01fec71:15436:1874219323454208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787395184.312777:0:15436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787395184.312780:0:15436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787395184.312782:0:15436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787395184.312799:0:15436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787395184.312801:0:15436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787395184.312802:0:15436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787395184.312803:0:15436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787395184.312805:0:15436:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787395184.312807:0:15436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787395184.312808:0:15436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787395184.312822:0:15436:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787395184.319751:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395184.319922:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787395184.320096:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395184.320249:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787395184.320436:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787395184.320659:0:15436:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787395184.322157:0:15436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787395184.432931:0:15436:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787395184.432940:0:15436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787395184.432972:0:15436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787395184.433027:0:15436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787395184.433042:0:15436:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787395184.433156:0:15436:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787395184.594826:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395185.622200:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787395186.258531:0:14128:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787395186.258540:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa0b336008000 from 8 10000000:01000000:1.0:1787395186.258545:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787395186.258602:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395186.258614:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395186.258624:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395186.258650:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323455104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787395186.258717:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395186.258769:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787395186.258869:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455104 00000100:00100000:2.0:1787395186.258876:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455104 00000100:00100000:2.0:1787395186.258930:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787395186.258939:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323455104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395186.258952:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395186.258965:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33fa48c00/0xedbabbe2e89a9251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a924a expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395186.258986:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33fa48c00/0xedbabbe2e89a9251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a924a expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395186.258997:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33fa48c00/0xedbabbe2e89a9251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a924a expref: 19 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395186.259005:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33fa48c00, rc 0) 00000100:00100000:2.0:1787395186.259063:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323455104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395186.259071:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787395186.259241:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323455104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395186.259257:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9251 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395186.259265:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a9251 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395186.259500:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323455232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787395186.259530:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395186.260145:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787395186.264388:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455232 00000100:00100000:0.0:1787395186.264405:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455232 00000100:00100000:0.0:1787395186.264657:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787395186.264667:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323455232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787395186.264698:0:14124:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787395186.264720:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787395186.264723:0:14124:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1787395186.264873:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323455232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 207us (5340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395186.264881:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787395186.264938:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323455232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787395186.265017:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787395186.265029:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9251 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395186.265041:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b339129c00/0xedbabbe2e89a924a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a9251 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395186.643434:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395186.775193:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323455360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395186.775256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395186.775861:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455360 00000100:00100000:0.0:1787395186.775869:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455360 00000100:00100000:0.0:1787395186.775922:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787395186.775944:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323455360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395186.775975:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395186.776032:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323455360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395186.776039:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787395186.776060:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395186.790671:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33676b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323455360:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787395186.876155:0:6626:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1787395187.666542:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395188.690488:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787395189.018037:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1787395189.333903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787395189.333911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787395189.333915:0:8:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787395189.334867:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa0b30524b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1787395189.334904:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa0b32fa52680 x1874219323455744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787395189.335139:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323455488:0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.335900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395189.336525:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323456128:0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.336557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395189.336585:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395189.336591:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323455616:0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.336612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395189.337745:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323455744:0@lo:8:kworker.0 00000100:00100000:2.0:1787395189.337899:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323455872:0@lo:400:kworker.0 00000100:00100000:2.0:1787395189.337945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395189.337974:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787395189.337981:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32fa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323456000:0@lo:400:kworker.0 00000100:00100000:2.0:1787395189.338017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395189.338044:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456128 00000100:00100000:2.0:1787395189.338052:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456128 00000100:00100000:0.0:1787395189.338068:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395189.338107:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455488 00000100:00100000:0.0:1787395189.338111:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455488 00000100:00100000:0.0:1787395189.338149:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787395189.338157:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455872 00000100:00100000:2.0:1787395189.338162:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455872 00000100:00100000:2.0:1787395189.338176:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456000 00000100:00100000:2.0:1787395189.338178:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456000 00000100:00100000:2.0:1787395189.338192:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787395189.338200:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323456128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395189.338264:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323456128:12345-0@lo:400:kworker.0 Request processed in 64us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395189.338272:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787395189.338288:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787395189.338294:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323455872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395189.338339:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323455872:12345-0@lo:400:kworker.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395189.338345:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787395189.338356:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787395189.338362:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323456000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395189.338387:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874219323456000:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395189.338393:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787395189.338408:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787395189.338438:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa53480 x1874219323456128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395189.338452:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323456128:0@lo:400:kworker.0 00010000:00080000:2.0:1787395189.338489:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa51c00 x1874219323456000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395189.338498:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1874219323456000:0@lo:400:kworker.0 00010000:00080000:2.0:1787395189.338506:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa53800 x1874219323455872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787395205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787395189.338513:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323455872:0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.340413:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3303:x1874219323455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.340475:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3303:x1874219323455488:12345-0@lo:400:kworker.0 Request processed in 70us (4577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395189.340482:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787395189.340527:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455616 00000100:00100000:0.0:1787395189.340532:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455616 00000100:00100000:0.0:1787395189.340580:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323455744 00000100:00100000:0.0:1787395189.340584:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323455744 00000100:00100000:0.0:1787395189.340598:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787395189.340607:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323455616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395189.340619:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3303:1874219323455488:0@lo:400:kworker.0 00000100:00100000:3.0:1787395189.340649:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787395189.340651:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323455616:12345-0@lo:400:kworker.0 Request processed in 46us (4037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395189.340661:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787395189.340665:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323455616:0@lo:400:kworker.0 00000100:00100000:0.0:1787395189.340677:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787395189.340684:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1874219323455744:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787395189.340708:0:14766:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 461 last 0 00000020:00000080:0.0:1787395189.340734:0:14766:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xedbabbe2e89a9258 00002000:00100000:0.0:1787395189.340746:0:14766:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa0b33f92c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211366c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787395189.342027:0:14766:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787395189.342032:0:14766:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787395189.342533:0:14766:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787395189.342563:0:14766:0:(import.c:65:import_set_state_nolock()) ffffa0b33f92c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787395189.342654:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1874219323455744:12345-0@lo:8:kworker.0 Request processed in 1969us (4586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395189.342664:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787395189.342868:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787395189.342940:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b32fa52680 x1874219323455744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787395214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787395189.342956:0:3302:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787395189.342964:0:3302:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787395189.342969:0:3302:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787395189.342972:0:3302:0:(import.c:65:import_set_state_nolock()) ffffa0b30524b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787395189.347653:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787395189.347672:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32fa52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1874219323455744:0@lo:8:kworker.0 00000004:00080000:2.0:1787395189.347817:0:14156:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787395189.347840:0:14156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14156:1874219323456384:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787395189.347899:0:14156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395189.347924:0:14156:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787395189.347975:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456384 00000100:00100000:2.0:1787395189.347981:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456384 00000100:00100000:2.0:1787395189.348032:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787395189.348041:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14156:x1874219323456384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787395189.350395:0:14768:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787395189.350404:0:14768:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787395189.350416:0:14768:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00100000:0.0:1787395189.351172:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323456256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395189.351240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395189.351328:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456256 00000100:00100000:0.0:1787395189.351335:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456256 00000100:00100000:0.0:1787395189.351377:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787395189.351386:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323456256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395189.351415:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395189.351457:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323456256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395189.351463:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787395189.351502:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa0b33677ed80 x1874219323456256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787395205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787395189.351520:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323456256:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1787395189.351667:0:14155:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787395189.352032:0:14155:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461300725012ns, next at 0ns, rc = 0 00000100:00080000:2.0:1787395189.357287:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787395189.357933:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.357944:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.357961:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.357966:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.357973:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.357989:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358000:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358009:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358047:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.358409:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.358418:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.358441:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.358447:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.358456:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.358476:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.358485:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fc9c166/0xedbabbe2e89a925f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.358510:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.358513:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.358517:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.358566:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.358574:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358584:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.358588:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.358598:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358618:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358626:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358633:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.358652:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787395189.358681:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787395189.358689:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395189.358698:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395189.358702:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395189.358711:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395189.358727:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395189.358747:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052fb00bf/0xedbabbe2e89a9266 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395189.358778:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395189.358781:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787395189.358783:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.359118:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.359124:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359132:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.359135:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.359139:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359148:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359156:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359175:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359190:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395189.359866:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.359873:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359883:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.359886:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.359890:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359900:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359909:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359916:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359933:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787395189.359943:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787395189.359948:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359963:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.359967:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359976:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359991:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.359999:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000323f74a7/0xedbabbe2e89a926d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360018:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.360022:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360029:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.360033:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360041:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360051:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360064:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098d50fe/0xedbabbe2e89a9274 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360081:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.360084:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.360086:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.360592:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.360599:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360608:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.360612:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.360617:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360626:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360635:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360642:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360658:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.360666:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.360676:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360683:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.360687:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360695:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360716:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360724:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a874f1f/0xedbabbe2e89a927b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.360737:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.360739:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.360741:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.361055:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.361239:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.361261:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361270:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.361273:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.361278:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361299:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361332:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361340:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361353:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.361360:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.361364:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361370:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48a00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.361373:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361381:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361392:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361399:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005852e6ef/0xedbabbe2e89a9282 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361419:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.361421:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.361423:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.361820:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.361826:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361835:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.361838:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.361843:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361852:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361860:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361866:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.361883:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.362091:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.362098:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.362106:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.362110:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.362132:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.362146:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.362154:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b58c81b/0xedbabbe2e89a9289 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.362177:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.362179:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.362182:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.362540:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.362548:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362569:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.362573:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.362578:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362589:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362598:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362606:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362623:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.362634:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.362639:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362647:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.362651:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362660:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362685:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362692:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007249a606/0xedbabbe2e89a9290 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.362712:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.362715:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.362718:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.363378:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.363387:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363398:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.363401:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.363407:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363417:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363426:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363434:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363462:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.363623:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.363629:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.363638:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038000 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.363643:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.363652:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.363667:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.363786:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006809dff6/0xedbabbe2e89a9297 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.363807:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.363809:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.363812:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.363971:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.363978:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.363987:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.363990:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.363994:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364005:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364013:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364021:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364035:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.364044:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.364049:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364056:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.364066:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364075:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364086:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364093:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a929e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364108:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.364110:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.364112:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.364756:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.364763:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364773:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.364776:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.364781:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364792:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364800:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364814:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.364829:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.364904:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.364910:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.364920:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.364924:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.364934:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.364947:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.364956:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e9391e9/0xedbabbe2e89a92a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.364976:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.364979:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.364981:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.365607:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.365615:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365630:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.365634:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.365639:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365650:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365659:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365667:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365684:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.365695:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.365700:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365713:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.365718:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365726:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365738:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365746:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e34c0f/0xedbabbe2e89a92ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.365762:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.365764:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.365766:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.366572:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.366581:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.366593:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.366597:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.366603:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.366614:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.366630:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.366637:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.366649:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787395189.367159:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.367165:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367175:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.367178:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.367182:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367191:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367198:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367205:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367232:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787395189.367243:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787395189.367259:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367266:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039e00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.367271:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367278:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367295:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367303:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb0299fc/0xedbabbe2e89a92b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367367:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.367370:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367377:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038600 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.367380:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367401:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367412:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367419:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9f742e/0xedbabbe2e89a92ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367435:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.367437:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.367439:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.367945:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.367953:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367962:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.367965:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.367970:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367980:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.367989:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368011:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368029:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.368039:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.368044:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368051:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039c00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.368055:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368063:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368075:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368152:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071e74a81/0xedbabbe2e89a92c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368171:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.368173:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.368175:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.368373:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.368807:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.368823:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368832:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.368836:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.368840:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368851:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368860:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368867:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368895:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.368906:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.368911:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368918:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039000 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.368923:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368931:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368952:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368959:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff1cf1b0/0xedbabbe2e89a92c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.368976:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.368978:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.368980:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.369828:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.369836:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.369847:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.369850:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.369855:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.369866:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.369874:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.369882:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370131:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.370503:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.370511:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.370523:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.370527:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.370537:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.370556:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.370563:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3045849/0xedbabbe2e89a92cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787395189.370712:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787395189.370794:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.370796:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.370798:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.370871:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370883:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.370887:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.370892:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370903:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370911:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370919:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370934:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.370943:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.370948:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370956:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.370966:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370975:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370987:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.370994:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa1ea97f/0xedbabbe2e89a92d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.371008:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.371010:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.371012:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787395189.371845:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787395189.371853:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.371865:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=461s v=(0 0) 00010000:00010000:2.0:1787395189.371868:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395189.371874:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.371885:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.371894:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.371908:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372019:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787395189.372078:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395189.372084:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.372092:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395189.372097:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.372117:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.372131:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.372139:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a79edda4/0xedbabbe2e89a92dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395189.372160:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.372162:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395189.372165:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.372655:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.372662:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.372672:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.372676:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.372681:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.372697:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.372705:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.372713:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.372733:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.372744:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.372751:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372759:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d400 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.372764:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372771:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372784:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372791:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdb3f21/0xedbabbe2e89a92e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.372810:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.372813:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.372815:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.373183:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.373189:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373199:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.373202:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.373207:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373217:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373225:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373253:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373270:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.373345:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.373352:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373366:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d000 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.373370:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373379:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373392:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373401:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032e5730f/0xedbabbe2e89a92eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373419:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.373421:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.373423:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.373703:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.373709:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373718:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.373722:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.373727:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373736:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373744:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373751:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.373769:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.373790:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.373796:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373803:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.373807:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373815:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373836:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373843:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a92f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.373860:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.373863:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.373867:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.374185:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.374192:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374206:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.374209:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.374213:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374223:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374231:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374239:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374275:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787395189.374687:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.374693:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374702:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.374705:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.374709:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374718:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374738:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374747:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.374758:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787395189.375154:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.375160:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.375169:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.375172:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.375177:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.375187:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.375195:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.375203:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.375225:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787395189.375343:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787395189.375350:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375359:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.375364:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375373:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375389:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375396:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe5f4101/0xedbabbe2e89a92f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375424:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787395189.375428:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375435:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55de00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.375439:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375446:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375458:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375465:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9a0884f/0xedbabbe2e89a9300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375485:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.375489:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375495:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.375499:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375517:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375527:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375535:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cd7fb2b/0xedbabbe2e89a9307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.375549:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.375552:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.375554:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.375560:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.376987:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.376998:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377011:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.377014:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.377020:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377032:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377041:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377050:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377066:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.377499:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.377506:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377516:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.377521:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377530:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377547:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377567:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083c37796/0xedbabbe2e89a930e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377589:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.377593:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.377595:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.377659:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.377666:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377675:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.377684:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.377688:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377699:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377707:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377715:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.377886:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.377956:0:14120:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.377962:0:14120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377972:0:14120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.377976:0:14120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377985:0:14120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.377997:0:14120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378005:0:14120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003b5f482/0xedbabbe2e89a9315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378023:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.378026:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.378028:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787395189.378519:0:14768:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787395189.378526:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.378535:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=461s v=(0 0) 00010000:00010000:3.0:1787395189.378539:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395189.378544:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.378554:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.378561:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.378575:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395189.378590:0:14768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787395189.378612:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787395189.378619:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378627:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c800 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395189.378631:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378639:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378652:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378658:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa2b6ca/0xedbabbe2e89a931c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395189.378673:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.378676:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787395189.378679:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787395189.378832:0:14768:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000004:00080000:2.0:1787395189.378849:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787395189.378923:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14156:x1874219323456384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 30880us (31020us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395189.378934:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787395189.378947:0:14156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14156:1874219323456384:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787395189.378964:0:14156:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787395189.379009:0:14156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14156:1874219323456512:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787395189.379043:0:14156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395189.379071:0:14156:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395189.379073:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456512 00000100:00100000:0.0:1787395189.379081:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456512 00000100:00100000:0.0:1787395189.379125:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787395189.379131:0:14769:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787395189.379136:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14156:x1874219323456512:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787395189.379142:0:14769:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1787395189.379174:0:14766:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787395189.385163:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14156:x1874219323456512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6022us (6110us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787395189.385176:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787395189.385438:0:14156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14156:1874219323456512:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787395189.385456:0:14156:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787395189.718289:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787395190.507282:0:15793:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787395190.746442:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395191.762721:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395191.890641:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323456640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395191.890713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395191.894069:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456640 00000100:00100000:3.0:1787395191.894086:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456640 00000100:00100000:3.0:1787395191.894596:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787395191.894608:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323456640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787395191.894644:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787395191.894666:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395191.894739:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874219323456640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (4024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395191.894746:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787395191.894839:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323456640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395192.479987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.484553:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591232 00000100:00100000:2.0:1787395192.484572:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591232 00000100:00100000:3.0:1787395192.484699:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:3.0:1787395192.484709:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2362:x1874219304591232:12345-192.168.203.16@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787395192.484747:0:14126:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from af942336-0a41-4b45-b914-6b487ea80ade@192.168.203.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1787395192.484778:0:14126:0:(genops.c:1406:class_connect()) connect: client af942336-0a41-4b45-b914-6b487ea80ade, cookie 0xedbabbe2e89a9323 00000100:00080000:3.0:1787395192.484913:0:14126:0:(import.c:65:import_set_state_nolock()) ffffa0b201aed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787395192.485002:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+5:2362:x1874219304591232:12345-192.168.203.16@tcp:250:mount.lustre.0 Request processed in 293us (5027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395192.485010:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:2.0:1787395192.488383:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.488473:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591360 00000100:00100000:0.0:1787395192.488485:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591360 00000100:00100000:0.0:1787395192.488542:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:0.0:1787395192.488552:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+5:13697:x1874219304591360:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787395192.488569:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395192.488588:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341011e00/0xedbabbe2e89a932a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2580 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.488617:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341011e00/0xedbabbe2e89a932a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2580 expref: 6 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.488645:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341011e00/0xedbabbe2e89a932a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2580 expref: 6 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.488655:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011e00, rc 0) 00000100:00100000:0.0:1787395192.488716:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+6:13697:x1874219304591360:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 166us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.488724:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:2.0:1787395192.490884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395192.493850:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591488 00000100:00100000:1.0:1787395192.493866:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591488 00000100:00100000:0.0:1787395192.496303:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395192.496345:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+6:13697:x1874219304591488:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787395192.496649:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+6:13697:x1874219304591488:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 317us (5773us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787395192.496658:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1787395192.501397:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.507554:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591616 00000100:00100000:2.0:1787395192.507971:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591616 00000100:00100000:2.0:1787395192.508040:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:2.0:1787395192.508050:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+6:13697:x1874219304591616:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787395192.508067:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395192.508083:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b336038200/0xedbabbe2e89a9331 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2587 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.508252:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b336038200/0xedbabbe2e89a9331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2587 expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.508265:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b336038200/0xedbabbe2e89a9331 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2587 expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.508275:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038200, rc 0) 00000100:00100000:2.0:1787395192.508383:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+7:13697:x1874219304591616:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 333us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.508390:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:2.0:1787395192.511918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395192.515885:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591744 00000100:00100000:3.0:1787395192.515903:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591744 00000100:00100000:3.0:1787395192.515977:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:3.0:1787395192.515987:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+7:13697:x1874219304591744:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787395192.516359:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+8:13697:x1874219304591744:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 372us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395192.516367:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:3.0:1787395192.519248:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.519340:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304591872 00000100:00100000:0.0:1787395192.519350:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304591872 00000100:00100000:0.0:1787395192.519404:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:0.0:1787395192.519435:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+8:13697:x1874219304591872:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787395192.519852:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+8:13697:x1874219304591872:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 392us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.519870:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:0.0:1787395192.523651:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.524075:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592000 00000100:00100000:2.0:1787395192.524086:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592000 00000100:00100000:2.0:1787395192.524162:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395192.524181:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+8:13716:x1874219304592000:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787395192.524505:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+8:13716:x1874219304592000:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 333us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.524514:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:2.0:1787395192.536824:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395192.536936:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592128 00000100:00100000:3.0:1787395192.536947:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592128 00000100:00100000:3.0:1787395192.537002:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:3.0:1787395192.537012:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+8:13716:x1874219304592128:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787395192.537302:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+8:13716:x1874219304592128:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 291us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395192.537351:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:3.0:1787395192.544662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.544770:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592256 00000100:00100000:0.0:1787395192.544781:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592256 00000100:00100000:0.0:1787395192.544840:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:0.0:1787395192.544850:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+8:13697:x1874219304592256:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787395192.544882:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395192.544900:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010600/0xedbabbe2e89a9338 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc25b1 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.544929:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010600/0xedbabbe2e89a9338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b1 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.544940:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010600/0xedbabbe2e89a9338 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b1 expref: 9 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395192.544949:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010600, rc 0) 00000100:00100000:0.0:1787395192.545013:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+9:13697:x1874219304592256:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 165us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.545021:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:0.0:1787395192.553497:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.553599:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592384 00000100:00100000:2.0:1787395192.553611:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592384 00000100:00100000:2.0:1787395192.553669:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:2.0:1787395192.553680:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+9:13697:x1874219304592384:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787395192.553705:0:14124:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787395192.553731:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787395192.553735:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787395192.553748:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787395192.553751:0:14124:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787395192.555821:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+9:13697:x1874219304592384:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 2131us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.556273:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:3.0:1787395192.558871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.559042:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592512 00000100:00100000:2.0:1787395192.559053:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592512 00000100:00100000:2.0:1787395192.559119:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:2.0:1787395192.559130:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+9:13697:x1874219304592512:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787395192.559146:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395192.559165:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc25b8 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.559194:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 10 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.559204:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 10 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.559241:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038a00, rc 0) 00000100:00100000:2.0:1787395192.559303:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+10:13697:x1874219304592512:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 175us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.559336:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:3.0:1787395192.562392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.562750:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592640 00000100:00100000:0.0:1787395192.562759:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592640 00000100:00100000:0.0:1787395192.562854:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:0.0:1787395192.562865:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+10:13697:x1874219304592640:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787395192.563147:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+10:13697:x1874219304592640:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 283us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.563155:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:3.0:1787395192.564619:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.564757:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592768 00000100:00100000:0.0:1787395192.564764:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592768 00000100:00100000:0.0:1787395192.564819:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:0.0:1787395192.564828:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+10:13697:x1874219304592768:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787395192.565014:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+10:13697:x1874219304592768:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 186us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.565022:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:3.0:1787395192.567891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.568088:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304592896 00000100:00100000:0.0:1787395192.568099:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304592896 00000100:00100000:0.0:1787395192.568219:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:0.0:1787395192.568240:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+10:13721:x1874219304592896:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787395192.571209:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+10:13721:x1874219304592896:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 2957us (3317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.571231:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:3.0:1787395192.581495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.582191:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593024 00000100:00100000:2.0:1787395192.582203:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593024 00000100:00100000:2.0:1787395192.582271:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:2.0:1787395192.582282:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+10:13721:x1874219304593024:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787395192.582671:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+10:13721:x1874219304593024:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 390us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.582680:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:3.0:1787395192.592899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.593522:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593152 00000100:00100000:2.0:1787395192.593532:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593152 00000100:00100000:2.0:1787395192.593599:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787395192.593609:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2362:x1874219304593152:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787395192.593642:0:14131:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bd992ac3-06c5-4038-92aa-c3202e68354d@192.168.203.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787395192.593705:0:14131:0:(genops.c:1406:class_connect()) connect: client bd992ac3-06c5-4038-92aa-c3202e68354d, cookie 0xedbabbe2e89a9346 00000004:00100000:2.0:1787395192.593737:0:14131:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787395192.593743:0:14131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787395192.631174:0:14131:0:(import.c:65:import_set_state_nolock()) ffffa0b32058e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787395192.631532:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2362:x1874219304593152:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 37922us (38643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395192.631544:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1787395192.634914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.635027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.635747:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593280 00000100:00100000:2.0:1787395192.635759:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593280 00000100:00100000:2.0:1787395192.635830:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593408 00000100:00100000:2.0:1787395192.635834:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593408 00000100:00100000:2.0:1787395192.635852:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787395192.635862:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:0:x1874219304593280:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787395192.635924:0:14132:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787395192.635995:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:0:x1874219304593280:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 134us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.636002:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787395192.636019:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787395192.636025:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593408:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787395192.636035:0:14132:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787395192.636054:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593408:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 29us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.636059:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1787395192.637841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395192.637886:0:14131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787395192.637896:0:14131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787395192.638051:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593536 00000100:00100000:3.0:1787395192.638058:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593536 00000100:00080000:0.0:1787395192.638418:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395192.640007:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:3.0:1787395192.640023:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593536:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787395192.640133:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593536:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 114us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395192.640141:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787395192.643474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395192.643516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.643589:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593664 00000100:00100000:2.0:1787395192.643599:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593664 00000100:00100000:2.0:1787395192.643645:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593792 00000100:00100000:2.0:1787395192.643648:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593792 00000100:00100000:2.0:1787395192.643677:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787395192.643686:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304593664:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787395192.643718:0:14769:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bd992ac3-06c5-4038-92aa-c3202e68354d@192.168.203.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787395192.643749:0:14769:0:(genops.c:1406:class_connect()) connect: client bd992ac3-06c5-4038-92aa-c3202e68354d, cookie 0xedbabbe2e89a934d 00002000:00100000:2.0:1787395192.643760:0:14769:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd992ac3-06c5-4038-92aa-c3202e68354d/ffffa0b202335800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787395192.643771:0:14769:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787395192.644117:0:14769:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787395192.644150:0:14769:0:(import.c:65:import_set_state_nolock()) ffffa0b202335000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395192.644363:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2362:x1874219304593664:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 676us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.644372:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787395192.644413:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1787395192.644419:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304593792:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787395192.644437:0:14769:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bd992ac3-06c5-4038-92aa-c3202e68354d@192.168.203.16@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1787395192.644456:0:14769:0:(genops.c:1406:class_connect()) connect: client bd992ac3-06c5-4038-92aa-c3202e68354d, cookie 0xedbabbe2e89a9354 00002000:00100000:2.0:1787395192.644461:0:14769:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd992ac3-06c5-4038-92aa-c3202e68354d/ffffa0b202330800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787395192.644477:0:14769:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787395192.644597:0:14769:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787395192.644616:0:14769:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395192.644642:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32fa53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2362:x1874219304593792:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 222us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.644649:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787395192.646850:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395192.646944:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304593920 00000100:00100000:1.0:1787395192.646954:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304593920 00000100:00100000:1.0:1787395192.647005:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787395192.647017:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593920:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787395192.650443:0:14134:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3347us 00000004:00200000:1.0:1787395192.662923:0:14134:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787395192.663130:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13697:x1874219304593920:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 16108us (16283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395192.663150:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00010000:00010000:1.0:1787395192.786588:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395192.876846:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395192.876941:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594048 00000100:00100000:2.0:1787395192.876952:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594048 00000100:00100000:2.0:1787395192.877013:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787395192.877024:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13742:x1874219304594048:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1787395192.877045:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395192.877071:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038e00/0xedbabbe2e89a935b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc25e2 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877134:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877148:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877162:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395192.877413:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787395192.877417:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395192.877510:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877541:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038e00/0xedbabbe2e89a935b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25e2 expref: 8 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877558:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25e2 expref: 7 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395192.877568:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:2.0:1787395192.877571:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395192.877574:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039600, rc 0) 00000100:00100000:2.0:1787395192.877642:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+7:13742:x1874219304594048:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 620us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395192.877650:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00010000:00010000:1.0:1787395193.810510:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395194.450756:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323457024:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.450820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395194.450871:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323457536:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.450893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395194.450914:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787395194.450919:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323456896:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.450942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395194.450959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323457408:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.450975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395194.451013:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457024 00000100:00100000:2.0:1787395194.451020:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457024 00000100:00100000:2.0:1787395194.451068:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395194.451077:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323457024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.451121:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323457024:12345-0@lo:400:kworker.0 Request processed in 45us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395194.451128:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787395194.451149:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457536 00000100:00100000:2.0:1787395194.451152:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457536 00000100:00100000:2.0:1787395194.451172:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457408 00000100:00100000:2.0:1787395194.451174:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457408 00000100:00100000:2.0:1787395194.451188:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787395194.451193:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323457536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.451232:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323457536:12345-0@lo:400:kworker.0 Request processed in 38us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395194.451238:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787395194.451248:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787395194.451254:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323457408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.451278:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874219323457408:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395194.451283:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787395194.451296:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787395194.451300:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395194.452227:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323457152:0@lo:400:kworker.0 00000100:00100000:0.0:1787395194.452264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395194.452287:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787395194.452293:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395194.452349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395194.452366:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323457280:0@lo:400:kworker.0 00000100:00100000:0.0:1787395194.452384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395194.452410:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456896 00000100:00100000:0.0:1787395194.452414:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456896 00000100:00100000:0.0:1787395194.452444:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787395194.452450:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3304:x1874219323456896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395194.452480:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3304:x1874219323456896:12345-0@lo:400:kworker.0 Request processed in 30us (1537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395194.452486:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787395194.452513:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323456768 00000100:00100000:0.0:1787395194.452516:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323456768 00000100:00100000:0.0:1787395194.452549:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787395194.452555:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323456768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787395194.452578:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395194.452609:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323456768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395194.452615:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787395194.452627:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395194.452635:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457280 00000100:00100000:0.0:1787395194.452638:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457280 00000100:00100000:0.0:1787395194.452657:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787395194.452662:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323457280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395194.452688:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323457280:12345-0@lo:400:kworker.0 Request processed in 26us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395194.452693:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787395194.452737:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323456768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395194.452748:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323457280:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.452929:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1874219323457408:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.452945:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323457024:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.452956:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323457536:0@lo:400:kworker.0 00000100:00100000:2.0:1787395194.452980:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323456896:0@lo:400:kworker.0 00000100:00100000:1.0:1787395194.454177:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457152 00000100:00100000:1.0:1787395194.454188:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457152 00000100:00100000:1.0:1787395194.454237:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787395194.454245:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323457152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395194.454302:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1874219323457152:12345-0@lo:400:kworker.0 Request processed in 59us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395194.454323:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787395194.454442:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1874219323457152:0@lo:400:kworker.0 00000001:00080000:3.0:1787395194.518955:0:7503:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1787395194.518973:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787395194.518981:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd992ac3-06c5-4038-92aa-c3202e68354d 00010000:00010000:1.0:1787395194.835448:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395195.492762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.502581:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594176 00000100:00100000:0.0:1787395195.502599:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594176 00000100:00100000:0.0:1787395195.502732:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787395195.502746:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:13794:x1874219304594176:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1787395195.502788:0:14132:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787395195.502892:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:13794:x1874219304594176:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 149us (10140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.502899:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00080000:2.0:1787395195.503114:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395195.512436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.512514:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594304 00000100:00100000:2.0:1787395195.512526:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594304 00000100:00100000:2.0:1787395195.512600:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787395195.512611:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13794:x1874219304594304:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1787395195.512647:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395195.512728:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd992ac3-06c5-4038-92aa-c3202e68354d+6:13794:x1874219304594304:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 118us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.512735:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00080000:0.0:1787395195.512845:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395195.523303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.523470:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594432 00000100:00100000:2.0:1787395195.523480:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594432 00000100:00100000:2.0:1787395195.523547:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787395195.523557:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd992ac3-06c5-4038-92aa-c3202e68354d+5:13794:x1874219304594432:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1787395195.523587:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395195.523667:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd992ac3-06c5-4038-92aa-c3202e68354d+5:13794:x1874219304594432:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 110us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.523675:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00080000:0.0:1787395195.524413:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787395195.668900:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.670348:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594560 00000100:00100000:0.0:1787395195.670361:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594560 00000100:00100000:0.0:1787395195.670432:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:0.0:1787395195.670442:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+10:13829:x1874219304594560:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787395195.670458:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395195.670476:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341010400/0xedbabbe2e89a9369 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc25e9 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.670504:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341010400/0xedbabbe2e89a9369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25e9 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.670515:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341010400/0xedbabbe2e89a9369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25e9 expref: 11 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.670546:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010400, rc 0) 00000100:00100000:0.0:1787395195.670617:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304594560:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 176us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.670624:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:1.0:1787395195.677964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.678150:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594688 00000100:00100000:0.0:1787395195.678160:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594688 00000100:00100000:0.0:1787395195.678225:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:0.0:1787395195.678234:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3108dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304594688:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787395195.678556:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3108dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304594688:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 321us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.678564:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:1.0:1787395195.684800:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.688303:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594816 00000100:00100000:2.0:1787395195.688335:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594816 00000100:00100000:2.0:1787395195.688421:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:2.0:1787395195.688432:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304594816:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787395195.688748:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304594816:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 317us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.688756:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:1.0:1787395195.695342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.695660:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304594944 00000100:00100000:2.0:1787395195.695670:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304594944 00000100:00100000:2.0:1787395195.695724:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:2.0:1787395195.695734:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+11:13833:x1874219304594944:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787395195.696876:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+11:13833:x1874219304594944:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 1134us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.696887:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:1.0:1787395195.705740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.705871:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595072 00000100:00100000:0.0:1787395195.705881:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595072 00000100:00100000:0.0:1787395195.705936:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 95 00000100:00100000:0.0:1787395195.705945:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+11:13833:x1874219304595072:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787395195.706229:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+11:13833:x1874219304595072:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 284us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.706238:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 95 00000100:00100000:1.0:1787395195.709032:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.709384:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595200 00000100:00100000:2.0:1787395195.709394:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595200 00000100:00100000:2.0:1787395195.709434:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:2.0:1787395195.709443:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+11:13829:x1874219304595200:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787395195.709458:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395195.709475:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b336038e00/0xedbabbe2e89a9370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2613 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.709500:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b336038e00/0xedbabbe2e89a9370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2613 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.709512:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b336038e00/0xedbabbe2e89a9370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2613 expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.709521:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038e00, rc 0) 00000100:00100000:2.0:1787395195.709627:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+12:13829:x1874219304595200:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 183us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.709642:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:1.0:1787395195.712117:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.712514:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595328 00000100:00100000:2.0:1787395195.712524:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595328 00000100:00100000:2.0:1787395195.712751:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:2.0:1787395195.712761:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+12:13829:x1874219304595328:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787395195.712784:0:14124:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787395195.712801:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787395195.712805:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787395195.712808:0:14124:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787395195.712811:0:14124:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787395195.714215:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+12:13829:x1874219304595328:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 1436us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.714227:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:1.0:1787395195.717841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.718032:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595456 00000100:00100000:0.0:1787395195.718042:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595456 00000100:00100000:0.0:1787395195.718104:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:0.0:1787395195.718113:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+12:13829:x1874219304595456:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787395195.718131:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395195.718148:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc261a expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.718195:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 13 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.718216:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 13 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395195.718225:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341011c00, rc 0) 00000100:00100000:0.0:1787395195.718282:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:13829:x1874219304595456:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 170us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.718290:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:1.0:1787395195.723104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.723195:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595584 00000100:00100000:2.0:1787395195.723214:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595584 00000100:00100000:2.0:1787395195.723271:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:2.0:1787395195.723281:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:13829:x1874219304595584:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787395195.723594:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:13829:x1874219304595584:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 313us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.723602:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:1.0:1787395195.728234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.728336:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595712 00000100:00100000:2.0:1787395195.728345:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595712 00000100:00100000:2.0:1787395195.728431:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:2.0:1787395195.728440:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13829:x1874219304595712:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787395195.728748:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13829:x1874219304595712:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 308us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.728756:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:1.0:1787395195.732719:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.733077:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595840 00000100:00100000:0.0:1787395195.733087:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595840 00000100:00100000:0.0:1787395195.733143:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:0.0:1787395195.733153:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:13837:x1874219304595840:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787395195.733450:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:13837:x1874219304595840:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 298us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.733459:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:1.0:1787395195.736022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.736119:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304595968 00000100:00100000:2.0:1787395195.736128:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304595968 00000100:00100000:2.0:1787395195.736211:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:2.0:1787395195.736221:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13837:x1874219304595968:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787395195.736468:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13837:x1874219304595968:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 248us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.736476:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 102 00000100:00100000:1.0:1787395195.739978:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.740279:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596096 00000100:00100000:0.0:1787395195.740290:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596096 00000100:00100000:0.0:1787395195.740380:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787395195.740388:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2362:x1874219304596096:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787395195.740417:0:15908:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f78daf99-fc77-40e6-8ec8-3331e3f6c70b@192.168.203.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1787395195.740451:0:15908:0:(genops.c:1406:class_connect()) connect: client f78daf99-fc77-40e6-8ec8-3331e3f6c70b, cookie 0xedbabbe2e89a937e 00000004:00100000:0.0:1787395195.740481:0:15908:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787395195.740601:0:15908:0:(import.c:65:import_set_state_nolock()) ffffa0b303525800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787395195.740690:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2362:x1874219304596096:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 301us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.740698:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:1.0:1787395195.744264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395195.744333:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395195.744439:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596352 00000100:00100000:3.0:1787395195.744448:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596352 00000100:00100000:3.0:1787395195.744512:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596224 00000100:00100000:3.0:1787395195.744515:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596224 00000100:00100000:3.0:1787395195.744533:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1787395195.744542:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+7:13829:x1874219304596352:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787395195.744573:0:14131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787395195.744646:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+7:13829:x1874219304596352:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 95us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395195.744655:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1787395195.744670:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:3.0:1787395195.744675:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:0:x1874219304596224:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787395195.744701:0:14131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787395195.744725:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:0:x1874219304596224:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 49us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395195.744731:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00080000:1.0:1787395195.745287:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395195.746954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.747032:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596480 00000100:00100000:0.0:1787395195.747049:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596480 00000100:00100000:0.0:1787395195.747097:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:0.0:1787395195.747106:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:13829:x1874219304596480:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787395195.747185:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:13829:x1874219304596480:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.747193:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:3.0:1787395195.749515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395195.749642:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596864 00000100:00100000:0.0:1787395195.749651:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596864 00000100:00100000:0.0:1787395195.749702:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:0.0:1787395195.749711:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:13829:x1874219304596864:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787395195.749998:0:14135:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787395195.750143:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:13829:x1874219304596864:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 433us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395195.750152:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:1.0:1787395195.761396:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395195.761435:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.761516:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596608 00000100:00100000:2.0:1787395195.761529:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596608 00000100:00100000:2.0:1787395195.761569:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596736 00000100:00100000:2.0:1787395195.761573:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596736 00000100:00100000:2.0:1787395195.761596:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395195.761605:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304596608:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787395195.761647:0:14769:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f78daf99-fc77-40e6-8ec8-3331e3f6c70b@192.168.203.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1787395195.761682:0:14769:0:(genops.c:1406:class_connect()) connect: client f78daf99-fc77-40e6-8ec8-3331e3f6c70b, cookie 0xedbabbe2e89a9385 00002000:00100000:2.0:1787395195.761692:0:14769:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f78daf99-fc77-40e6-8ec8-3331e3f6c70b/ffffa0b327f7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787395195.761703:0:14769:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787395195.761800:0:14769:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787395195.761828:0:14769:0:(import.c:65:import_set_state_nolock()) ffffa0b327f7f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395195.761895:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2362:x1874219304596608:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 290us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.761904:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395195.761922:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:2.0:1787395195.761926:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2362:x1874219304596736:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787395195.761940:0:14769:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f78daf99-fc77-40e6-8ec8-3331e3f6c70b@192.168.203.16@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:2.0:1787395195.761962:0:14769:0:(genops.c:1406:class_connect()) connect: client f78daf99-fc77-40e6-8ec8-3331e3f6c70b, cookie 0xedbabbe2e89a938c 00002000:00100000:2.0:1787395195.761966:0:14769:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f78daf99-fc77-40e6-8ec8-3331e3f6c70b/ffffa0b327f7d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211366c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787395195.761989:0:14769:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787395195.762373:0:14769:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787395195.762392:0:14769:0:(import.c:65:import_set_state_nolock()) ffffa0b302d9c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787395195.762415:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2362:x1874219304596736:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 488us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.762422:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00010000:00010000:1.0:1787395195.858473:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395195.878461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395195.878570:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304596992 00000100:00100000:2.0:1787395195.878579:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304596992 00000100:00100000:2.0:1787395195.878644:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:2.0:1787395195.878655:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:13858:x1874219304596992:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1787395195.878674:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395195.878694:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a9393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2644 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.878756:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.878768:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.878780:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395195.878973:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787395195.878977:0:14132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395195.879042:0:14132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.879067:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a9393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 8 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.879093:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 7 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395195.879102:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:2.0:1787395195.879105:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395195.879109:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038600, rc 0) 00000100:00100000:2.0:1787395195.879168:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+7:13858:x1874219304596992:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 515us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395195.879175:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00010000:00010000:2.0:1787395196.890387:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395197.015965:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787395197.015987:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b336769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323457664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395197.016064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395197.016133:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457664 00000100:00100000:3.0:1787395197.016140:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457664 00000100:00100000:3.0:1787395197.016210:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787395197.016218:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323457664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787395197.016239:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787395197.016291:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323457664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395197.016298:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787395197.016343:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787395197.016378:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b336769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323457664:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787395197.054362:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f78daf99-fc77-40e6-8ec8-3331e3f6c70b 00000001:00100000:2.0:1787395197.054375:0:6626:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd992ac3-06c5-4038-92aa-c3202e68354d 00010000:00010000:1.0:1787395197.911631:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787395198.140432:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f78daf99-fc77-40e6-8ec8-3331e3f6c70b 00000001:00100000:0.0:1787395198.140453:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd992ac3-06c5-4038-92aa-c3202e68354d 00000001:02000400:3.0:1787395198.675062:0:15995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787395198.931032:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787395199.252382:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787395199.570825:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323457920:0@lo:400:kworker.0 00000100:00100000:1.0:1787395199.570939:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395199.570967:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323458176:0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.571022:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323457792:0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.571040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395199.571053:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323458432:0@lo:400:kworker.0 00000100:00100000:2.0:1787395199.571284:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323458048:0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.571525:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458176 00000100:00100000:0.0:1787395199.571534:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458176 00000100:00100000:0.0:1787395199.571585:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787395199.571594:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323458176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.571730:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874219323458176:12345-0@lo:400:kworker.0 Request processed in 136us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395199.571738:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787395199.571798:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874219323458176:0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.571870:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457920 00000100:00100000:0.0:1787395199.571875:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457920 00000100:00100000:0.0:1787395199.571912:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787395199.571919:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323457920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.572022:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323457920:12345-0@lo:400:kworker.0 Request processed in 103us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395199.572029:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787395199.572196:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395199.575895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395199.575982:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458432 00000100:00100000:1.0:1787395199.575994:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458432 00000100:00100000:1.0:1787395199.576089:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787395199.576106:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b327e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323458432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395199.576205:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b327e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874219323458432:12345-0@lo:400:kworker.0 Request processed in 107us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395199.576215:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787395199.576782:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787395199.576840:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1874219323458432:0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.576859:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323457920:0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.576887:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787395199.576897:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787395199.576956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395199.579433:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458560 00000100:00100000:1.0:1787395199.579450:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458560 00000100:00100000:1.0:1787395199.580627:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787395199.580727:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323458560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787395199.580780:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395199.580897:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323458560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 254us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395199.580906:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787395199.581877:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787395199.582082:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787395199.582116:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323458560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395199.583245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395199.583245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395199.583298:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458048 00000100:00100000:2.0:1787395199.583326:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458048 00000100:00100000:3.0:1787395199.583342:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323458304:0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.583568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395199.583610:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458304 00000100:00100000:3.0:1787395199.583614:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458304 00000100:00100000:3.0:1787395199.583655:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787395199.583663:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323458304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.583711:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323458304:12345-0@lo:400:kworker.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395199.583718:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787395199.583741:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787395199.583776:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323458304:0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.583836:0:15729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787395199.583843:0:15729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323458048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.583879:0:15729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323458048:12345-0@lo:400:kworker.0 Request processed in 37us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395199.583885:0:15729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787395199.584066:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323457792 00000100:00100000:0.0:1787395199.584071:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323457792 00000100:00100000:0.0:1787395199.584101:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787395199.584107:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323457792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787395199.584153:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323457792:12345-0@lo:400:kworker.0 Request processed in 45us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395199.584159:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787395199.584828:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323458048:0@lo:400:kworker.0 00000100:00100000:3.0:1787395199.584866:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323457792:0@lo:400:kworker.0 00000001:00100000:1.0:1787395199.637785:0:7503:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f78daf99-fc77-40e6-8ec8-3331e3f6c70b 00010000:00010000:1.0:1787395199.954413:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395200.897734:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395200.897778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395200.897811:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395200.897828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395200.897843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395200.897938:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597120 00000100:00100000:0.0:1787395200.897947:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597120 00000100:00100000:0.0:1787395200.897992:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 104 00000100:00100000:0.0:1787395200.898000:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:2364:x1874219304597120:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395200.898020:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597376 00000100:00100000:2.0:1787395200.898026:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597376 00000100:00100000:0.0:1787395200.898069:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:2364:x1874219304597120:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395200.898075:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597888 00000100:00100000:0.0:1787395200.898077:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 104 00000100:00100000:2.0:1787395200.898081:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597888 00000100:00100000:2.0:1787395200.898113:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787395200.898115:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597632 00000100:00100000:0.0:1787395200.898119:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597632 00000100:00100000:2.0:1787395200.898124:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2364:x1874219304597376:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395200.898155:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:2.0:1787395200.898163:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2364:x1874219304597376:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395200.898176:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2364:x1874219304597632:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395200.898202:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:0.0:1787395200.898212:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2364:x1874219304597632:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 47us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395200.898223:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1787395200.898224:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:2.0:1787395200.898239:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33676b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2364:x1874219304597888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395200.898273:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33676b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2364:x1874219304597888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395200.898280:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00080000:2.0:1787395200.898638:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787395200.898644:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787395200.898646:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395200.898826:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597248 00000100:00100000:0.0:1787395200.898831:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597248 00000100:00100000:0.0:1787395200.898879:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:0.0:1787395200.898885:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2364:x1874219304597248:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395200.898918:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2364:x1874219304597248:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395200.898924:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:0.0:1787395200.898958:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395200.898997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395200.899012:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597504 00000100:00100000:0.0:1787395200.899015:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597504 00000100:00100000:0.0:1787395200.899034:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304597760 00000100:00100000:0.0:1787395200.899036:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304597760 00000100:00100000:0.0:1787395200.899050:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395200.899056:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2364:x1874219304597504:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395200.899080:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2364:x1874219304597504:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395200.899086:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395200.899095:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:0.0:1787395200.899100:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2364:x1874219304597760:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395200.899116:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2364:x1874219304597760:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 16us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395200.899122:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00080000:3.0:1787395200.899222:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787395200.899226:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787395200.899228:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787395200.980659:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787395201.945731:0:16146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe6f040040 00000020:00000080:2.0:1787395201.945749:0:16146:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787395201.945754:0:16146:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787395201.945762:0:16146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6f0422d0 20000000:00000080:2.0:1787395201.945768:0:16146:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa0b201af4000 uarg=0000000000000000 20000000:01000000:2.0:1787395201.945808:0:16146:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787395201.945814:0:16146:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787395201.945818:0:16146:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787395201.946703:0:16147:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1787395201.946864:0:16146:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787395201.953969:0:16146:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787395201.954576:0:16146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954596:0:16146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954604:0:16146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 18 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954610:0:16146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954635:0:16146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954643:0:16146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.954650:0:16146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955370:0:16146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955397:0:16146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 12 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.955412:0:16146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458688:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395201.955528:0:16146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955537:0:16146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.955545:0:16146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458816:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395201.955577:0:16146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955584:0:16146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.955593:0:16146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458944:0@lo:104: 00000100:00100000:3.0:1787395201.955632:0:16146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787395201.955667:0:16146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 18 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955676:0:16146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 18 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.955685:0:16146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323459072:0@lo:104: 00000100:00100000:3.0:1787395201.955706:0:16146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395201.955750:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323458944 00000100:00100000:3.0:1787395201.955757:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323458944 00000100:00100000:3.0:1787395201.955794:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459072 00000100:00100000:3.0:1787395201.955797:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459072 00000100:00100000:3.0:1787395201.955811:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395201.955820:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+4:16146:x1874219323458944:12345-0@lo:104: 00010000:00010000:3.0:1787395201.955834:0:14114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955883:0:14114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787395201.955890:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+4:16146:x1874219323458944:12345-0@lo:104: Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.955896:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395201.955913:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787395201.955919:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:16146:x1874219323459072:12345-0@lo:104: 00010000:00010000:3.0:1787395201.955926:0:14114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.955955:0:14114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787395201.955976:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:16146:x1874219323459072:12345-0@lo:104: Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.955982:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787395201.956071:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787395201.956077:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956084:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa48200 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395201.956088:0:14119:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956109:0:14119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395201.956116:0:14119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395201.956122:0:14119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787395201.956149:0:14119:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956155:0:14119:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395201.956189:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956197:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33fa48200/0xedbabbe2e89a9212 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9219 expref: -99 pid: 15436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956210:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395201.956214:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956219:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d800 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395201.956223:0:14119:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956229:0:14119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395201.956236:0:14119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395201.956248:0:14119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787395201.956262:0:14119:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956268:0:14119:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395201.956276:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956282:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33f55d800/0xedbabbe2e89a90de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a90e5 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956291:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395201.956293:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395201.956294:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395201.956337:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323459328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395201.956370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395201.956394:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787395201.956400:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323459200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395201.956421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395201.956452:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459328 00000100:00100000:3.0:1787395201.956456:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459328 00010000:00010000:3.0:1787395201.956474:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 19 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395201.956479:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395201.956492:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459200 00000100:00100000:3.0:1787395201.956496:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459200 00010000:00010000:3.0:1787395201.956507:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 20 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.956531:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395201.956537:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+20:3306:x1874219323459328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395201.956548:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395201.956553:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 20 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956561:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 20 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956576:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395201.956612:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+20:3306:x1874219323459328:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.956619:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787395201.956631:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787395201.956637:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323459200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395201.956644:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395201.956648:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 19 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956656:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 19 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956665:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395201.956686:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323459200:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.956692:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787395201.956723:0:16146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 18 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956739:0:16146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 18 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.956749:0:16146:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323459456:0@lo:104: 00000100:00100000:3.0:1787395201.956776:0:16146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395201.956804:0:14114:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787395201.956813:0:14114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459456 00000100:00100000:3.0:1787395201.956816:0:14114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459456 00000100:00100000:3.0:1787395201.956834:0:14114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787395201.956840:0:14114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3395a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:16146:x1874219323459456:12345-0@lo:104: 00010000:00010000:3.0:1787395201.956847:0:14114:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956876:0:14114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787395201.956881:0:14114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3395a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+3:16146:x1874219323459456:12345-0@lo:104: Request processed in 42us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.956887:0:14114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787395201.956920:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787395201.956924:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956931:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33fa49000 already unused, calling callback (ffffffffc1bb5c20) 10000000:00010000:3.0:1787395201.956934:0:14119:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956940:0:14119:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787395201.956957:0:14119:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787395201.956963:0:14119:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787395201.956978:0:14119:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.956983:0:14119:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787395201.957012:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.957019:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffffa0b33fa49000/0xedbabbe2e89a9091 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xedbabbe2e89a9098 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.957035:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395201.957036:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787395201.957038:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395201.957044:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787395201.957054:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323459584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395201.957081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395201.957104:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459584 00000100:00100000:3.0:1787395201.957108:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459584 00010000:00010000:3.0:1787395201.957122:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 19 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.957135:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787395201.957141:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33f8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3304:x1874219323459584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787395201.957148:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395201.957173:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 19 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.957182:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 19 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.957193:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395201.957221:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33f8e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3304:x1874219323459584:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395201.957228:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787395201.957281:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3304:1874219323459584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395201.957326:0:16146:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b302469cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1787395201.957342:0:16146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341010200/0xedbabbe2e89a9219 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9212 expref: 18 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.957353:0:16146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458944:0@lo:104: 00010000:00010000:3.0:1787395201.957362:0:16146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341010800/0xedbabbe2e89a90e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a90de expref: 17 pid: 14124 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.957370:0:16146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323459072:0@lo:104: 00010000:00010000:3.0:1787395201.957377:0:16146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341011a00/0xedbabbe2e89a9098 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xedbabbe2e89a9091 expref: 16 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.957386:0:16146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323459456:0@lo:104: 00000100:00100000:1.0:1787395201.959538:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323459200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787395201.959553:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323459328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787395201.966688:0:16146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458688:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395201.966705:0:16146:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16146:1874219323458816:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395201.966746:0:16146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395201.966968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395201.967061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395201.967180:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598016 00000100:00100000:2.0:1787395201.967189:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598016 00010000:00010000:2.0:1787395201.967225:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 13 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395201.967264:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598144 00000100:00100000:2.0:1787395201.967268:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598144 00010000:00010000:2.0:1787395201.967283:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 14 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395201.967301:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395201.967330:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af942336-0a41-4b45-b914-6b487ea80ade+14:2363:x1874219304598016:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395201.967345:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395201.967353:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 14 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395201.967357:0:14117:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787395201.967369:0:14117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1787395201.967369:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 14 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967392:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b341011c00/0xedbabbe2e89a9377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc261a expref: 14 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967434:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395201.967498:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af942336-0a41-4b45-b914-6b487ea80ade+13:2363:x1874219304598016:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 170us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395201.967511:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395201.967532:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787395201.967540:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af942336-0a41-4b45-b914-6b487ea80ade+12:2363:x1874219304598144:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395201.967549:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395201.967555:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967566:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967578:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b336038a00/0xedbabbe2e89a933f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25b8 expref: 12 pid: 14126 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967590:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967599:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967614:0:14118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967622:0:14118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967641:0:14118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967647:0:14118:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967653:0:14118:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038c00 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:2.0:1787395201.967658:0:14118:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967667:0:14118:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967683:0:14118:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395201.967693:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395201.967721:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af942336-0a41-4b45-b914-6b487ea80ade+11:2363:x1874219304598144:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 181us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395201.967729:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00010000:00010000:3.0:1787395201.967844:0:16146:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.967853:0:16146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395201.967860:0:16146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa0b336038c00/0xedbabbe2e89a93a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395202.005446:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787395202.133675:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323459712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787395202.133749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395202.133819:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459712 00000100:00100000:0.0:1787395202.133826:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459712 00000100:00100000:0.0:1787395202.133873:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787395202.133880:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323459712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787395202.133915:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787395202.133956:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323459712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395202.133970:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787395202.134067:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395202.135300:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323459712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787395203.027078:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787395203.218537:0:14128:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787395203.218545:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b33f928800 from 10 10000000:01000000:0.0:1787395203.218549:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787395203.218596:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395203.218608:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395203.218618:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395203.218641:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323459840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.218706:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395203.218759:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395203.218807:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459840 00000100:00100000:3.0:1787395203.218815:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459840 00000100:00100000:3.0:1787395203.218864:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787395203.218873:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+16:14128:x1874219323459840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395203.218888:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395203.218902:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a93af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a93a8 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.218923:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a93af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a93a8 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.218932:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d400/0xedbabbe2e89a93af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a93a8 expref: 17 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.218953:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d400, rc 0) 00000100:00100000:3.0:1787395203.219002:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323459840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.219019:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787395203.219275:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323459840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395203.219301:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93af expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395203.219347:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a93af expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395203.219403:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.219432:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395203.219450:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787395203.219772:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323459968 00000100:00100000:0.0:1787395203.219778:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323459968 00000100:00100000:0.0:1787395203.219919:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787395203.219927:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323459968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.220203:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323459968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395203.220210:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787395203.220581:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.220618:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.220665:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395203.220694:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b57d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787395203.220717:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460096 00000100:00100000:2.0:1787395203.220723:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460096 00000100:00100000:2.0:1787395203.220757:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787395203.220764:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323460096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787395203.220926:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323460096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395203.220934:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787395203.220951:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787395203.221927:0:16198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787395203.222359:0:14128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787395203.222377:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787395203.222387:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93af expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395203.222408:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341011800/0xedbabbe2e89a93a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93af expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787395203.222419:0:14128:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787395203.222421:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b337f3f800 from 10 10000000:01000000:0.0:1787395203.222424:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787395203.222452:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395203.222460:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395203.222469:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395203.222489:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.222534:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395203.222568:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395203.222626:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460224 00000100:00100000:3.0:1787395203.222633:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460224 00000100:00100000:3.0:1787395203.222673:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787395203.222681:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+17:14128:x1874219323460224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395203.222693:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395203.222705:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a93bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a93b6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.222725:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a93bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a93b6 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.222735:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d000/0xedbabbe2e89a93bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a93b6 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.222743:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d000, rc 0) 00000100:00100000:3.0:1787395203.222781:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.222788:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787395203.223054:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395203.223067:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93bd expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395203.223087:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a93bd expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395203.223134:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.223232:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395203.223257:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b57900 going to sleep for 11 seconds 00000100:00100000:2.0:1787395203.223291:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460352 00000100:00100000:2.0:1787395203.223339:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460352 00000100:00100000:2.0:1787395203.223373:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787395203.223380:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787395203.223644:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395203.223652:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787395203.223673:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.223703:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.223740:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395203.223766:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b318b57900 going to sleep for 11 seconds 00000100:00100000:0.0:1787395203.223804:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460480 00000100:00100000:0.0:1787395203.223809:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460480 00000100:00100000:0.0:1787395203.223839:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787395203.223846:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.223983:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395203.223991:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787395203.224083:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787395203.225625:0:16199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787395203.225828:0:14128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787395203.225846:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787395203.225856:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93bd expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395203.225866:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b341011a00/0xedbabbe2e89a93b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93bd expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787395203.225875:0:14128:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787395203.225877:0:14128:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa0b336008000 from 10 10000000:01000000:2.0:1787395203.225880:0:14128:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787395203.225910:0:14128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395203.225917:0:14128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395203.225926:0:14128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395203.225945:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787395203.225998:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395203.226040:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b341364b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787395203.226106:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460608 00000100:00100000:3.0:1787395203.226113:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460608 00000100:00100000:3.0:1787395203.226167:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787395203.226176:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+18:14128:x1874219323460608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395203.226187:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395203.226198:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a93cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xedbabbe2e89a93c4 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.226220:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a93cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xedbabbe2e89a93c4 expref: 19 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.226241:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55d800/0xedbabbe2e89a93cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xedbabbe2e89a93c4 expref: 19 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.226248:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d800, rc 0) 00000100:00100000:3.0:1787395203.226289:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323460608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.226296:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787395203.226472:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787395203.226497:0:14128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93cb expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395203.226506:0:14128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xedbabbe2e89a93cb expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395203.226552:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787395203.226576:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395203.226590:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b341364b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787395203.226725:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460736 00000100:00100000:1.0:1787395203.226729:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460736 00000100:00100000:1.0:1787395203.226761:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787395203.226768:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323460736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.226995:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323460736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395203.227001:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787395203.227481:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.227512:0:14128:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b32926dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787395203.227559:0:14128:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395203.227578:0:14128:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395203.227955:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460864 00000100:00100000:1.0:1787395203.227961:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460864 00000100:00100000:1.0:1787395203.227995:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787395203.228003:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323460864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.228204:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:14128:x1874219323460864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395203.228218:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787395203.233579:0:14128:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b32926dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd69c846-0fd6-4b2d-8c27-adaad01fec71:14128:1874219323460864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787395203.237905:0:16201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787395203.238065:0:14128:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787395203.238084:0:14128:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787395203.238096:0:14128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93cb expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395203.238107:0:14128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffffa0b336039000/0xedbabbe2e89a93c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xedbabbe2e89a93cb expref: -99 pid: 14128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395203.328846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395203.328917:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598272 00000100:00100000:1.0:1787395203.328927:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598272 00000100:00100000:1.0:1787395203.328983:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:1.0:1787395203.328991:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+11:13711:x1874219304598272:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787395203.329008:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395203.329025:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b339128c00/0xedbabbe2e89a93d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc264b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395203.329052:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b339128c00/0xedbabbe2e89a93d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc264b expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395203.329063:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b339128c00/0xedbabbe2e89a93d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc264b expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395203.329072:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128c00, rc 0) 00000100:00100000:1.0:1787395203.329136:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598272:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395203.329142:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 114 00000100:00100000:3.0:1787395203.340947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395203.340982:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598400 00000100:00100000:3.0:1787395203.340991:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598400 00000100:00100000:3.0:1787395203.341042:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:3.0:1787395203.341051:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598400:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787395203.341425:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598400:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 372us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.341535:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 115 00000100:00100000:3.0:1787395203.343100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395203.343130:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598528 00000100:00100000:3.0:1787395203.343138:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598528 00000100:00100000:3.0:1787395203.343191:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:3.0:1787395203.343199:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598528:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787395203.343400:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598528:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 200us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.343407:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 116 00000100:00100000:3.0:1787395203.361760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395203.361798:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598656 00000100:00100000:3.0:1787395203.361807:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598656 00000100:00100000:3.0:1787395203.361853:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:3.0:1787395203.361862:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+12:13711:x1874219304598656:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787395203.361880:0:14126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395203.361896:0:14126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a93d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2652 expref: -99 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.361922:0:14126:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a93d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2652 expref: 13 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.361934:0:14126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa0b33f55c800/0xedbabbe2e89a93d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2652 expref: 13 pid: 14126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395203.361943:0:14126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c800, rc 0) 00000100:00100000:3.0:1787395203.361992:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:13711:x1874219304598656:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 131us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395203.361998:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 117 00000100:00100000:1.0:1787395203.380374:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395203.380414:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598784 00000100:00100000:1.0:1787395203.380424:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598784 00000100:00100000:1.0:1787395203.380472:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:1.0:1787395203.380482:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:13711:x1874219304598784:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.380759:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:13711:x1874219304598784:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 277us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395203.380778:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 118 00000100:00100000:0.0:1787395203.385778:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395203.385851:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304598912 00000100:00100000:1.0:1787395203.385862:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304598912 00000100:00100000:1.0:1787395203.385913:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 119 00000100:00100000:1.0:1787395203.385924:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13711:x1874219304598912:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787395203.386229:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:af942336-0a41-4b45-b914-6b487ea80ade+13:13711:x1874219304598912:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 304us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395203.386237:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 119 00010000:00010000:1.0:1787395204.050734:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395204.692927:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323461120:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395204.693067:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323461632:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395204.693122:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787395204.693129:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323460992:0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.693154:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461120 00000100:00100000:3.0:1787395204.693163:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461120 00000100:00100000:1.0:1787395204.693170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395204.693206:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323461504:0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.693226:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787395204.693231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395204.693241:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323461120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693262:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323460992 00000100:00100000:1.0:1787395204.693267:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323460992 00000100:00100000:1.0:1787395204.693297:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787395204.693330:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323460992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.693339:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323461120:12345-0@lo:400:kworker.0 Request processed in 102us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395204.693349:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787395204.693368:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323460992:12345-0@lo:400:kworker.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395204.693377:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323461376:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693400:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787395204.693425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395204.693451:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787395204.693458:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461632 00000100:00100000:3.0:1787395204.693459:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323461248:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693464:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461632 00000100:00100000:3.0:1787395204.693488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395204.693497:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461504 00000100:00100000:1.0:1787395204.693501:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461504 00000100:00100000:3.0:1787395204.693510:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323461760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787395204.693519:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461376 00000100:00100000:1.0:1787395204.693523:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461376 00000100:00100000:3.0:1787395204.693540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787395204.693544:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787395204.693552:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323461632:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787395204.693590:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787395204.693596:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395204.693606:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874219323461632:12345-0@lo:400:kworker.0 Request processed in 55us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395204.693608:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461248 00000100:00100000:3.0:1787395204.693613:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461248 00000100:00100000:1.0:1787395204.693618:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787395204.693635:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787395204.693642:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323461504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.693649:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787395204.693659:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323461248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.693684:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323461504:12345-0@lo:400:kworker.0 Request processed in 42us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395204.693693:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787395204.693702:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323461248:12345-0@lo:400:kworker.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395204.693709:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787395204.693713:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787395204.693720:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323461376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.693740:0:14771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323461760 00000100:00100000:3.0:1787395204.693745:0:14771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323461760 00000100:00100000:1.0:1787395204.693754:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874219323461376:12345-0@lo:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395204.693762:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787395204.693784:0:14771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787395204.693792:0:14771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323461760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787395204.693816:0:14771:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787395204.693832:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323460992:0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.694463:0:14771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323461760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395204.695296:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323461504:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.695334:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323461120:0@lo:400:kworker.0 00000100:00100000:1.0:1787395204.695363:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1874219323461632:0@lo:400:kworker.0 00000100:00080000:1.0:1787395204.695416:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787395204.708457:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323461248:0@lo:400:kworker.0 00000100:00100000:2.0:1787395204.708523:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323461760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787395204.708538:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874219323461376:0@lo:400:kworker.0 00000100:00100000:3.0:1787395204.719033:0:14771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787395205.074646:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395205.195047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395205.195273:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599040 00000100:00100000:3.0:1787395205.195289:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599040 00000100:00100000:3.0:1787395205.195420:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787395205.195435:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+6:14368:x1874219304599040:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395205.195483:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395205.195516:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a93e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2659 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195620:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195639:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195653:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195669:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195676:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.195683:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196246:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a93f5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196257:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196264:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395205.196386:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787395205.196396:0:14131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395205.196502:0:14131:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a93f5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196515:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196521:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196527:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196533:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395205.196538:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196546:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196560:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:3.0:1787395205.196564:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395205.196574:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196581:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a93e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196597:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196602:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196618:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196624:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55ce00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395205.196626:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196633:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196640:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa0b308bf3900) 00010000:00010000:3.0:1787395205.196643:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395205.196645:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196651:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a93ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196693:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a93e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2659 expref: 8 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196708:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55de00/0xedbabbe2e89a93f5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2659 expref: 7 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.196715:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b308bf3e00) 00010000:00010000:3.0:1787395205.196718:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787395205.196720:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55de00, rc 0) 00000100:00100000:3.0:1787395205.196811:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+7:14368:x1874219304599040:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1379us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395205.196830:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00080000:1.0:1787395205.197593:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395205.208031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395205.210171:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599296 00000100:00100000:0.0:1787395205.210192:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599296 00000100:00100000:0.0:1787395205.210334:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:0.0:1787395205.210348:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:14368:x1874219304599296:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787395205.210375:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787395205.210406:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a93fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2660 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210507:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210524:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210867:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210888:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210896:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.210903:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.228859:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a9411 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.228886:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.228899:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a9411 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395205.228912:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787395205.238988:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239009:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239018:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239025:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395205.239030:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239039:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239059:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa0b308bf3e00) 00010000:00010000:1.0:1787395205.239063:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395205.239067:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239073:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9403 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239100:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239107:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239129:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239145:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395205.239148:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239154:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239649:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa0b318946200) 00010000:00010000:1.0:1787395205.239654:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395205.239658:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.239666:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011400/0xedbabbe2e89a940a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.242799:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011600/0xedbabbe2e89a93fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2660 expref: 10 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.242836:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010a00/0xedbabbe2e89a9411 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2660 expref: 9 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.242846:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:1.0:1787395205.242849:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395205.242853:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b341010a00, rc 0) 00000100:00100000:1.0:1787395205.243708:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14368:x1874219304599296:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 33357us (35683us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787395205.243738:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:0.0:1787395205.258457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395205.260654:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599424 00000100:00100000:3.0:1787395205.260676:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599424 00000100:00100000:3.0:1787395205.260768:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787395205.260780:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14368:x1874219304599424:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787395205.260939:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14368:x1874219304599424:12345-192.168.203.16@tcp:59:lhsmtool_posix.0 Request processed in 160us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395205.260948:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:3.0:1787395205.298052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.298293:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599552 00000100:00100000:2.0:1787395205.298357:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599552 00000100:00100000:2.0:1787395205.298442:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:2.0:1787395205.298454:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14374:x1874219304599552:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.298481:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.298527:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a941f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2667 expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298629:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298647:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298662:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298679:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298687:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.298695:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299038:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299048:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299055:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299062:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.299067:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299086:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299102:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:2.0:1787395205.299106:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.299112:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299119:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299147:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299154:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299500:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299507:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.299511:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299518:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299528:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.299531:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.299583:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299601:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a942d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299648:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a941f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2667 expref: 10 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299659:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:2.0:1787395205.299661:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.299665:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a941f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2667 expref: 10 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.299676:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039200, rc 0) 00000100:00100000:2.0:1787395205.299755:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14374:x1874219304599552:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1304us (1714us total) trans 0 rc 301/301 00000100:00100000:2.0:1787395205.299765:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787395205.305980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395205.306233:0:14140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599680 00000100:00100000:3.0:1787395205.306246:0:14140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599680 00000100:00100000:2.0:1787395205.306516:0:14141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787395205.306529:0:14141:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14374:x1874219304599680:12345-192.168.203.16@tcp:700:lfs.0 00000100:00100000:2.0:1787395205.306653:0:14141:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14374:x1874219304599680:12345-192.168.203.16@tcp:700:lfs.0 Request processed in 125us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.306661:0:14141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1787395205.313254:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395205.313362:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304599936 00000100:00100000:3.0:1787395205.313375:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304599936 00000100:00100000:3.0:1787395205.313449:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787395205.313460:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14374:x1874219304599936:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:3.0:1787395205.313549:0:14131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395205.313586:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a9362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc25e2 expref: 9 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.313610:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:3.0:1787395205.313615:0:14131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787395205.313957:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.314243:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 5 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.314268:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.314389:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 5 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395205.314407:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 5 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395205.314427:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323461888:192.168.203.16@tcp:104: 00000100:00100000:3.0:1787395205.316256:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b30b8f66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787395205.325722:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291b1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323461888:192.168.203.16@tcp:104: 00010000:00010000:3.0:1787395205.325759:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395205.339042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.340247:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600064 00000100:00100000:2.0:1787395205.340267:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600064 00010000:00010000:2.0:1787395205.340398:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 6 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395205.340457:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1787395205.340487:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2364:x1874219304600064:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395205.340507:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395205.340517:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 6 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340532:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 6 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340576:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a939a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2644 expref: 6 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340598:0:14118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:2.0:1787395205.340604:0:14118:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340615:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340622:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.340652:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395205.340729:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2364:x1874219304600064:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 244us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.340737:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00010000:00010000:0.0:1787395205.340969:0:14131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.340978:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.341013:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.341024:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.341032:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787395205.343018:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787395205.343042:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343068:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343076:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343083:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55d200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:0.0:1787395205.343088:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343096:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343116:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc600) 00010000:00010000:0.0:1787395205.343120:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787395205.343125:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395205.343131:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55d200/0xedbabbe2e89a9434 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395205.343172:0:14131:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003cb5c4f0 reply state 00000000462d8e9b transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395205.343181:0:14131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395205.343370:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14374:x1874219304599936:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 29841us (30058us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787395205.343383:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00080000:1.0:1787395205.344715:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787395205.353215:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353237:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353263:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353270:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.353276:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353285:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353344:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0b318946900) 00010000:00010000:2.0:1787395205.353349:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.353356:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.353363:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011200/0xedbabbe2e89a943b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787395205.395780:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787395205.558399:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.559822:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600192 00000100:00100000:2.0:1787395205.559840:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600192 00000100:00100000:2.0:1787395205.559938:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:2.0:1787395205.559951:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+9:14382:x1874219304600192:12345-192.168.203.16@tcp:101:lctl.0 00010000:00010000:2.0:1787395205.559986:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.560021:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc266e expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560114:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a9449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560166:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a9449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560182:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a9449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.560268:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787395205.560273:0:14133:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.560376:0:14133:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a9449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560406:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc266e expref: 11 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560430:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039200/0xedbabbe2e89a9449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc266e expref: 10 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.560440:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.560454:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395205.560459:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039200, rc 0) 00000100:00100000:2.0:1787395205.560563:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14382:x1874219304600192:12345-192.168.203.16@tcp:101:lctl.0 Request processed in 614us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.560572:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:1.0:1787395205.644226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.644387:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600320 00000100:00100000:2.0:1787395205.644402:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600320 00000100:00100000:2.0:1787395205.644491:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:2.0:1787395205.644505:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:14383:x1874219304600320:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.644536:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.644595:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2675 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644712:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a9457 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644733:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a9457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644749:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a9457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.644846:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787395205.644852:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.644889:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a9457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644935:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2675 expref: 7 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644960:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039800/0xedbabbe2e89a9457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2675 expref: 6 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.644970:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.644974:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395205.644978:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039800, rc 0) 00000100:00100000:2.0:1787395205.645091:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:14383:x1874219304600320:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 589us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.645101:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:3.0:1787395205.659176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.659263:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600448 00000100:00100000:2.0:1787395205.659293:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600448 00000100:00100000:2.0:1787395205.659430:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:2.0:1787395205.659442:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:14383:x1874219304600448:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.659471:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.659499:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a945e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc267c expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659610:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659627:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659642:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659660:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659667:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.659674:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669346:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669374:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669388:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.669500:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787395205.669505:0:14133:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.669531:0:14133:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669552:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669559:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669565:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669571:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.669575:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669583:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669596:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.669599:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.669604:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669610:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a9465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669628:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669646:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669652:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669657:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.669661:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669666:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669675:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395205.669677:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.669680:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669686:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a946c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669728:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a945e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc267c expref: 8 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669742:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc267c expref: 7 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.669749:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395205.669751:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395205.669762:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039c00, rc 0) 00000100:00100000:2.0:1787395205.669836:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+7:14383:x1874219304600448:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 10395us (10670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.669845:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:1.0:1787395205.676920:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.677050:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600704 00000100:00100000:2.0:1787395205.677065:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600704 00000100:00100000:2.0:1787395205.677158:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:2.0:1787395205.677169:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+7:14383:x1874219304600704:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.677196:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.677222:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a947a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2683 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.677442:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787395205.677606:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a947a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2683 expref: 9 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.677623:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.677626:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395205.677632:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a947a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2683 expref: 9 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.677649:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038600, rc 0) 00000100:00100000:2.0:1787395205.677730:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+8:14383:x1874219304600704:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 562us (830us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787395205.677738:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 23 00000100:00100000:1.0:1787395205.685887:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.686046:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304600960 00000100:00100000:2.0:1787395205.686060:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304600960 00000100:00100000:2.0:1787395205.686151:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:2.0:1787395205.686181:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+8:14383:x1874219304600960:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:2.0:1787395205.686262:0:14132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395205.686302:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9473 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc267c expref: 8 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.686387:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395205.686403:0:14132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395205.686438:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.686454:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.686466:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787395205.686795:0:14132:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004b19960e reply state 0000000008e35dc2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395205.686808:0:14132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787395205.686824:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787395205.686934:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+9:14383:x1874219304600960:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 755us (1060us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787395205.686943:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 24 00000100:00100000:3.0:1787395205.694516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395205.694631:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694647:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694656:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694679:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.694686:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694695:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694720:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395205.694724:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787395205.694730:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.694736:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a9488 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395205.694925:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304601216 00000100:00100000:1.0:1787395205.694943:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304601216 00000100:00100000:1.0:1787395205.695061:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:1.0:1787395205.695074:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+8:14383:x1874219304601216:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:1.0:1787395205.695444:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+9:14383:x1874219304601216:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 371us (941us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787395205.695452:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787395205.702244:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.702387:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304601472 00000100:00100000:2.0:1787395205.702397:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304601472 00000100:00100000:2.0:1787395205.702466:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:2.0:1787395205.702476:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+9:14383:x1874219304601472:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.702500:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.702520:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a948f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc268a expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702608:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702623:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702635:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702667:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702675:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702681:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.702814:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787395205.702904:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702913:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702919:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702925:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.702930:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702937:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702950:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.702960:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.702964:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702981:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a9496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.702995:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703015:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703022:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703026:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.703029:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703035:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703044:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395205.703046:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.703049:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703055:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a949d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703092:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a948f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc268a expref: 11 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703114:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.703117:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395205.703121:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a948f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc268a expref: 11 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.703131:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038600, rc 0) 00000100:00100000:2.0:1787395205.703207:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+10:14383:x1874219304601472:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 733us (974us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787395205.703215:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 25 00000100:00100000:3.0:1787395205.711905:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.712325:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304601600 00000100:00100000:2.0:1787395205.712340:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304601600 00000100:00100000:2.0:1787395205.712399:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:2.0:1787395205.712409:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+10:14383:x1874219304601600:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395205.712435:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.712457:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2691 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712539:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712552:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712561:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.712609:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787395205.712626:0:14132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.712652:0:14132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712677:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712695:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.712703:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395205.712706:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395205.712709:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039e00, rc 0) 00000100:00100000:2.0:1787395205.712807:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:14383:x1874219304601600:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 398us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.712815:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:3.0:1787395205.725459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395205.726363:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304601728 00000100:00100000:1.0:1787395205.726381:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304601728 00000100:00100000:1.0:1787395205.726468:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:1.0:1787395205.726482:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:14383:x1874219304601728:12345-192.168.203.16@tcp:37:lfs.0 00000100:00100000:1.0:1787395205.733210:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:14383:x1874219304601728:12345-192.168.203.16@tcp:37:lfs.0 Request processed in 6716us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395205.733232:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:3.0:1787395205.745744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.745859:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304601984 00000100:00100000:2.0:1787395205.745875:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304601984 00000100:00100000:2.0:1787395205.745952:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1787395205.745962:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b302a64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:14383:x1874219304601984:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395205.746270:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b302a64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+12:14383:x1874219304601984:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 308us (538us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787395205.746278:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:3.0:1787395205.813502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.813615:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304602112 00000100:00100000:2.0:1787395205.813626:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304602112 00000100:00100000:2.0:1787395205.813691:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:2.0:1787395205.813701:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14389:x1874219304602112:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395205.813721:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.813756:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2698 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813823:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813837:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813848:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813863:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813869:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813875:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.813997:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a94ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814014:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a94ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814022:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a94ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.814053:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787395205.814057:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.814096:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a94ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814115:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814122:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814144:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814151:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.814155:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814162:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814176:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395205.814179:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.814182:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814189:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814203:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814209:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814215:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814226:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.814229:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814235:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814243:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395205.814245:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.814248:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814254:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814285:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2698 expref: 12 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814298:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039c00/0xedbabbe2e89a94ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2698 expref: 11 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.814388:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395205.814391:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787395205.814394:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039c00, rc 0) 00000100:00100000:2.0:1787395205.814483:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14389:x1874219304602112:12345-192.168.203.16@tcp:101:bash.0 Request processed in 783us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.814491:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:3.0:1787395205.820830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.822840:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304602368 00000100:00100000:2.0:1787395205.822874:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304602368 00000100:00100000:2.0:1787395205.823041:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:2.0:1787395205.823052:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14389:x1874219304602368:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395205.823071:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.823093:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc269f expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.823228:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.823243:0:14132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.823252:0:14132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.823286:0:14132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 11 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.823300:0:14132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 11 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395205.823334:0:14132:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14132:1874219323462016:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395205.823426:0:14132:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b33f914f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787395205.829475:0:14132:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14132:1874219323462016:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395205.829502:0:14132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395205.829993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.830075:0:16148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304602496 00000100:00100000:2.0:1787395205.830097:0:16148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304602496 00010000:00010000:2.0:1787395205.830149:0:16148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 12 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395205.830189:0:16148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395205.830198:0:16148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+12:2364:x1874219304602496:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395205.830213:0:16148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395205.830219:0:16148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 12 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830231:0:16148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 12 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830485:0:16148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2691 expref: 12 pid: 14132 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830505:0:16148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395205.830511:0:16148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830520:0:16148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830527:0:16148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.830558:0:16148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787395205.830612:0:16148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:2364:x1874219304602496:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 414us (620us total) trans 0 rc 0/0 00010000:00010000:1.0:1787395205.830618:0:14132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.830626:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395205.830630:0:16148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00010000:00010000:1.0:1787395205.830656:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.830666:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.830673:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831413:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831422:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831429:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395205.831437:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787395205.831457:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831462:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831466:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831470:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038800 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395205.831473:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831486:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831494:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:1.0:1787395205.831496:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395205.831498:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831502:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038800/0xedbabbe2e89a94dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787395205.831510:0:14132:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099bad03b reply state 000000002c7c9ebe transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395205.831516:0:14132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787395205.831541:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038400/0xedbabbe2e89a94d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 14 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831551:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.831555:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395205.831557:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787395205.831558:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129600, rc 0) 00000100:00100000:1.0:1787395205.831599:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+14:14389:x1874219304602368:12345-192.168.203.16@tcp:101:bash.0 Request processed in 8550us (10784us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787395205.831604:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00010000:00010000:2.0:1787395205.839981:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840002:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840009:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840015:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395205.840020:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840028:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840043:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0b318517300) 00010000:00010000:2.0:1787395205.840047:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395205.840052:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.840067:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a94e3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395205.860510:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.862052:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304602624 00000100:00100000:2.0:1787395205.862066:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304602624 00000100:00100000:2.0:1787395205.862158:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:2.0:1787395205.862169:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14389:x1874219304602624:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395205.862195:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395205.862233:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26a6 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862376:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862390:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862403:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395205.862443:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787395205.862447:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395205.862464:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862474:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862499:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a94f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26a6 expref: 15 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862519:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26a6 expref: 14 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395205.862528:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395205.862531:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395205.862535:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038600, rc 0) 00000100:00100000:2.0:1787395205.862615:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+14:14389:x1874219304602624:12345-192.168.203.16@tcp:101:bash.0 Request processed in 448us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395205.862634:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:3.0:1787395205.881737:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.881838:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304602880 00000100:00100000:2.0:1787395205.881848:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304602880 00000100:00100000:2.0:1787395205.881912:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1787395205.881922:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+14:14389:x1874219304602880:12345-192.168.203.16@tcp:35:bash.0 00000100:00100000:2.0:1787395205.882276:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+15:14389:x1874219304602880:12345-192.168.203.16@tcp:35:bash.0 Request processed in 355us (549us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787395205.882284:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:3.0:1787395205.989211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395205.989420:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603136 00000100:00100000:1.0:1787395205.989438:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603136 00000100:00100000:1.0:1787395205.989506:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:1.0:1787395205.989517:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+15:14399:x1874219304603136:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1787395205.989541:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395205.989562:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26ad expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395205.989694:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787395205.989819:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9506 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26ad expref: 17 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.989835:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:1.0:1787395205.989838:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395205.989843:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26ad expref: 17 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395205.989859:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129e00, rc 0) 00000100:00100000:1.0:1787395205.989983:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14399:x1874219304603136:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 467us (785us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787395205.989990:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:3.0:1787395205.997469:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395205.999969:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603392 00000100:00100000:2.0:1787395205.999991:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603392 00000100:00100000:2.0:1787395206.000688:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:2.0:1787395206.000700:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14399:x1874219304603392:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395206.001460:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14399:x1874219304603392:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 756us (3997us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787395206.001469:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1787395206.018906:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.018958:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.018997:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.019042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395206.019045:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603648 00000100:00100000:0.0:1787395206.019055:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603648 00000100:00100000:3.0:1787395206.019072:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.019107:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395206.019115:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604160 00000100:00100000:0.0:1787395206.019118:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604160 00000100:00100000:3.0:1787395206.019140:0:15729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603776 00000100:00100000:3.0:1787395206.019146:0:15729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603776 00000100:00100000:1.0:1787395206.019158:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604032 00000100:00100000:1.0:1787395206.019164:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604032 00000100:00100000:3.0:1787395206.019179:0:15729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:3.0:1787395206.019191:0:15729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304603648:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395206.019199:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1787395206.019210:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304603776:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395206.019219:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787395206.019228:0:14766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1787395206.019248:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603520 00000100:00100000:0.0:1787395206.019251:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603520 00000100:00100000:3.0:1787395206.019272:0:15729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304603648:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395206.019281:0:15729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395206.019282:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304603904 00000100:00100000:0.0:1787395206.019287:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1787395206.019290:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304603904 00000100:00100000:0.0:1787395206.019298:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:2365:x1874219304603520:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1787395206.019339:0:15729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787395206.019349:0:15729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304604032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1787395206.019363:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:2.0:1787395206.019373:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:2365:x1874219304603904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395206.022864:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304603776:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3472us (3607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395206.022880:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1787395206.022939:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787395206.022959:0:15729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304604032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3610us (3849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395206.022959:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:af942336-0a41-4b45-b914-6b487ea80ade+13:2365:x1874219304603520:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3660us (3913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395206.022969:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1787395206.023244:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+11:2365:x1874219304603904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3871us (4282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395206.023254:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 22 00000100:00100000:3.0:1787395206.023274:0:15729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1787395206.023282:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304604160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1787395206.023300:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787395206.023324:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395206.023369:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304604160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 94us (4369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395206.023377:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787395206.064556:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395206.064641:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604416 00000100:00100000:2.0:1787395206.064653:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604416 00000100:00100000:2.0:1787395206.064717:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:2.0:1787395206.064745:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14402:x1874219304604416:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395206.064771:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395206.064790:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a9514 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26b4 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.064914:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a951b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.064929:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a951b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.064942:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a951b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395206.064962:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787395206.065257:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a9514 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26b4 expref: 20 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.065278:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a951b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26b4 expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.065287:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395206.065290:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395206.065293:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038a00, rc 0) 00000100:00100000:2.0:1787395206.066565:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14402:x1874219304604416:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1812us (2014us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787395206.066576:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1787395206.077545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.077593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395206.077751:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604544 00000100:00100000:2.0:1787395206.077761:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604544 00000100:00100000:2.0:1787395206.077853:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:2.0:1787395206.077864:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b336768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+19:2363:x1874219304604544:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395206.078147:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395206.078174:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a951b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26b4 expref: 19 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.078194:0:14118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395206.078199:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395206.078365:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604672 00000100:00100000:1.0:1787395206.078371:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604672 00000100:00100000:1.0:1787395206.078401:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1787395206.078408:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14402:x1874219304604672:12345-192.168.203.16@tcp:54:lfs.0 00010000:00010000:1.0:1787395206.078465:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078480:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078496:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078523:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078530:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078536:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078542:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395206.078547:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078565:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078574:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395206.078577:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787395206.078581:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.078588:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9529 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395206.079222:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b336768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+19:2363:x1874219304604544:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 1355us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395206.079232:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787395206.080381:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+18:14402:x1874219304604672:12345-192.168.203.16@tcp:54:lfs.0 Request processed in 1967us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395206.080394:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:3.0:1787395206.091219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395206.092293:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304604928 00000100:00100000:2.0:1787395206.092373:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304604928 00000100:00100000:2.0:1787395206.092465:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1787395206.092478:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+18:14402:x1874219304604928:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395206.092822:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14402:x1874219304604928:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 346us (1615us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787395206.092831:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00010000:00010000:1.0:1787395206.098530:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787395206.681395:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395206.683148:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304605184 00000100:00100000:1.0:1787395206.683168:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304605184 00000100:00100000:1.0:1787395206.683277:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:1.0:1787395206.683290:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14434:x1874219304605184:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:1.0:1787395206.683367:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395206.683403:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9530 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26bb expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.683532:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9537 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.683550:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.683583:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9537 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395206.683598:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787395206.683787:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a9530 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26bb expref: 22 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.683813:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9537 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26bb expref: 21 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.683823:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395206.683827:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395206.683831:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395206.683924:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+21:14434:x1874219304605184:12345-192.168.203.16@tcp:101:cat.0 Request processed in 637us (2542us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787395206.683933:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:3.0:1787395206.693114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395206.693230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395206.694524:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304605312 00000100:00100000:0.0:1787395206.694556:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304605312 00000100:00100000:0.0:1787395206.694675:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:0.0:1787395206.694690:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+21:2366:x1874219304605312:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395206.694710:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395206.694746:0:14116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9537 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26bb expref: 21 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395206.694774:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:0.0:1787395206.694780:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395206.694876:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+20:2366:x1874219304605312:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 190us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395206.694903:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1787395206.698905:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304605568 00000100:00100000:2.0:1787395206.699041:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304605568 00000100:00100000:2.0:1787395206.699238:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1787395206.699252:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+20:14434:x1874219304605568:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:2.0:1787395206.699814:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+21:14434:x1874219304605568:12345-192.168.203.16@tcp:35:cat.0 Request processed in 563us (6582us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787395206.699834:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1787395206.846342:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395206.846530:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304605824 00000100:00100000:2.0:1787395206.846570:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304605824 00000100:00100000:2.0:1787395206.846653:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:2.0:1787395206.846664:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+21:14440:x1874219304605824:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1787395206.846696:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395206.846731:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9545 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26c2 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.846877:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a954c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.846896:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a954c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.846911:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a954c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395206.846923:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787395206.847096:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9545 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c2 expref: 24 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.847120:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a954c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c2 expref: 23 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.847140:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395206.847143:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395206.847147:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039e00, rc 0) 00000100:00100000:2.0:1787395206.847228:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14440:x1874219304605824:12345-192.168.203.16@tcp:101:dd.0 Request processed in 565us (900us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787395206.847236:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:3.0:1787395206.852554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395206.852680:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304606080 00000100:00100000:1.0:1787395206.852693:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304606080 00000100:00100000:1.0:1787395206.852781:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:1.0:1787395206.852793:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14440:x1874219304606080:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1787395206.853012:0:14133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787395206.853048:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a954c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c2 expref: 23 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.853074:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038600/0xedbabbe2e89a94ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26a6 expref: 22 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.853101:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395206.853107:0:14133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787395206.855647:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.855677:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395206.855691:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395206.858247:0:14133:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787395206.861116:0:14133:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000446553a7 reply state 00000000a52e4f1a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395206.861149:0:14133:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395206.864075:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+24:14440:x1874219304606080:12345-192.168.203.16@tcp:36:dd.0 Request processed in 11264us (11515us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787395206.864094:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000020:00080000:1.0:1787395206.864107:0:14133:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395206.868964:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.868986:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.868995:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.869001:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395206.869007:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.869014:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.869038:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395206.869055:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395206.869062:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395206.869069:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a955a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395206.984451:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395206.989281:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304606336 00000100:00100000:1.0:1787395206.989385:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304606336 00000100:00100000:1.0:1787395206.989492:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:1.0:1787395206.989507:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14440:x1874219304606336:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:1.0:1787395206.991743:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+24:14440:x1874219304606336:12345-192.168.203.16@tcp:35:dd.0 Request processed in 2228us (7293us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1787395206.991760:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00010000:00010000:3.0:1787395207.123068:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787395207.250821:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787395207.250873:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323462144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787395207.252405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395207.252564:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323462144 00000100:00100000:2.0:1787395207.252577:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323462144 00000100:00100000:2.0:1787395207.252663:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787395207.252676:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323462144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787395207.252726:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395207.252797:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874219323462144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395207.252822:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787395207.254202:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395207.254287:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1874219323462144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787395207.294430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395207.294607:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304606464 00000100:00100000:2.0:1787395207.294623:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304606464 00000100:00100000:2.0:1787395207.294728:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:2.0:1787395207.294741:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+24:14454:x1874219304606464:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:2.0:1787395207.294772:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395207.294798:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9561 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26c9 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.294885:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787395207.294901:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787395207.294902:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.294916:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.294933:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.294940:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.294947:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295085:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295113:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295131:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395207.295179:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787395207.295184:0:14131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395207.295229:0:14131:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295243:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295252:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295260:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295266:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295271:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395207.295275:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295283:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295297:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395207.295338:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395207.295344:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295351:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9568 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295369:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295375:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295380:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295386:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395207.295389:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295395:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295403:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395207.295406:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395207.295409:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295414:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a956f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295746:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9561 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c9 expref: 26 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295778:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c9 expref: 25 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.295786:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395207.295789:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395207.295792:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039400, rc 0) 00000100:00100000:2.0:1787395207.295917:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+25:14454:x1874219304606464:12345-192.168.203.16@tcp:101:stat.0 Request processed in 1179us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395207.295927:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:0.0:1787395207.402231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395207.402360:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304606720 00000100:00100000:2.0:1787395207.402372:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304606720 00000100:00100000:2.0:1787395207.402463:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1787395207.402475:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+25:14460:x1874219304606720:12345-192.168.203.16@tcp:36:truncate.0 00010000:00010000:2.0:1787395207.402554:0:14132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395207.402590:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a9576 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26c9 expref: 25 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.402613:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395207.402619:0:14132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395207.402918:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.402935:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.402947:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787395207.403029:0:14132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1787395207.403064:0:14132:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000320761d reply state 0000000093d24cce transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395207.403074:0:14132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787395207.403240:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b32926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+27:14460:x1874219304606720:12345-192.168.203.16@tcp:36:truncate.0 Request processed in 765us (1019us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787395207.403249:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000020:00080000:2.0:1787395207.403256:0:14132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787395207.407671:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407692:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407700:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407706:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395207.407712:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407721:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407743:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395207.407747:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395207.407753:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.407759:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a957d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395207.657239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395207.659810:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304606848 00000100:00100000:1.0:1787395207.659830:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304606848 00000100:00100000:1.0:1787395207.660051:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:1.0:1787395207.660079:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+26:14474:x1874219304606848:12345-192.168.203.16@tcp:101:stat.0 00010000:00010000:1.0:1787395207.660114:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395207.660279:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a9584 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26d0 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660405:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660422:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660436:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660454:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660461:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660468:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660629:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660637:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660644:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395207.660689:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1787395207.660694:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395207.660721:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660735:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660745:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660752:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660759:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660765:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395207.660771:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660779:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660802:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:1.0:1787395207.660805:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395207.660810:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660816:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a958b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660833:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660840:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660846:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660853:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395207.660856:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660862:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660869:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0b318517800) 00010000:00010000:1.0:1787395207.660872:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395207.660874:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660880:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128200/0xedbabbe2e89a9592 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660933:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129800/0xedbabbe2e89a9584 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 28 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.660949:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 27 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.661609:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:1.0:1787395207.661612:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787395207.661617:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128a00, rc 0) 00000100:00100000:1.0:1787395207.661723:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+27:14474:x1874219304606848:12345-192.168.203.16@tcp:101:stat.0 Request processed in 1651us (4494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395207.661734:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1787395207.842107:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395207.842259:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304607104 00000100:00100000:2.0:1787395207.842273:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304607104 00000100:00100000:2.0:1787395207.842393:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:2.0:1787395207.842406:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+27:14484:x1874219304607104:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395207.842443:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395207.842477:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26d7 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395207.842663:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787395207.842821:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d7 expref: 29 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.842840:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395207.842844:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395207.842848:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d7 expref: 29 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.842867:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038a00, rc 0) 00000100:00100000:2.0:1787395207.842966:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+28:14484:x1874219304607104:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 563us (870us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1787395207.842974:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 39 00000100:00100000:3.0:1787395207.847378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395207.847531:0:14135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304607360 00000100:00100000:2.0:1787395207.847552:0:14135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304607360 00000100:00100000:2.0:1787395207.847631:0:14135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1787395207.847642:0:14135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b31873c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+28:14484:x1874219304607360:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1787395207.848519:0:14135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b31873c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+29:14484:x1874219304607360:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 873us (1146us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787395207.848552:0:14135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:0.0:1787395207.952923:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395207.953190:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304607616 00000100:00100000:2.0:1787395207.953203:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304607616 00000100:00100000:2.0:1787395207.953388:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:2.0:1787395207.953401:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+29:14490:x1874219304607616:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395207.953442:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395207.953470:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95ae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26de expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953622:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953641:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 30 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953649:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 30 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953658:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953702:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 30 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.953718:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 30 pid: 15908 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395207.953735:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323462272:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395207.954007:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 30 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.954018:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 30 pid: 14132 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395207.954027:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323462400:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395207.954055:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787395207.960345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395207.960395:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304607744 00000100:00100000:3.0:1787395207.960407:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304607744 00000100:00100000:0.0:1787395207.960641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:3.0:1787395207.961937:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 31 pid: 15908 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395207.961999:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304607872 00000100:00100000:3.0:1787395207.962007:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304607872 00010000:00010000:3.0:1787395207.962025:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 32 pid: 14132 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395207.962058:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1787395207.962138:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+32:2364:x1874219304607744:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395207.962161:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395207.962170:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 32 pid: 15908 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.962186:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 32 pid: 15908 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.962214:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:3.0:1787395207.962237:0:14117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.962247:0:14117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.962253:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395207.962356:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a5f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+32:2364:x1874219304607744:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 288us (2052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395207.962364:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787395207.962595:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:0.0:1787395207.962610:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+31:2364:x1874219304607872:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787395207.962620:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787395207.962626:0:14116:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 31 pid: 14132 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395207.962637:0:14116:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 31 pid: 14132 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395207.962650:0:14116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:0.0:1787395207.962654:0:14116:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395207.962663:0:14116:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395207.962671:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395207.962694:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395207.965860:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+31:2364:x1874219304607872:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 3242us (5205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395207.965881:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00010000:00010000:2.0:1787395207.967758:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9599 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26d0 expref: 30 pid: 15908 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395207.967861:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323462272:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395207.967884:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a94ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc269f expref: 29 pid: 14132 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395207.967898:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323462400:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395207.967930:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.967941:0:14131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.967947:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395207.968038:0:14131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1787395207.968592:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95ae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 30 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.968628:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 29 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.968638:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395207.968642:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787395207.968645:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039400, rc 0) 00000100:00100000:2.0:1787395207.968715:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+29:14490:x1874219304607616:12345-192.168.203.16@tcp:101:bash.0 Request processed in 15317us (15804us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1787395207.968725:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 40 00000100:00100000:2.0:1787395207.979204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395207.979505:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608128 00000100:00100000:1.0:1787395207.979520:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608128 00000100:00100000:1.0:1787395207.979632:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 41 00000100:00100000:1.0:1787395207.979646:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+29:14490:x1874219304608128:12345-192.168.203.16@tcp:36:bash.0 00010000:00010000:1.0:1787395207.980408:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.980570:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395207.980587:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787395207.980666:0:14132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1787395207.980698:0:14132:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000004bbe260 reply state 00000000be7a409d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395207.980730:0:14132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395207.981243:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+32:14490:x1874219304608128:12345-192.168.203.16@tcp:36:bash.0 Request processed in 1594us (2045us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1787395207.981255:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 41 00000020:00080000:1.0:1787395207.981262:0:14132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787395207.987746:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395207.988179:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988195:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988204:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988211:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395207.988217:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988227:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988252:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395207.988255:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395207.988282:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395207.988288:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395207.988556:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608256 00000100:00100000:3.0:1787395207.988569:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608256 00000100:00100000:3.0:1787395207.988641:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:3.0:1787395207.988653:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+31:14490:x1874219304608256:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395207.988684:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395207.988707:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a95ca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26e5 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.988779:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a95ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26e5 expref: 32 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.988806:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a95ca lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26e5 expref: 32 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395207.988828:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:3.0:1787395207.988831:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395207.988833:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55cc00, rc 0) 00000100:00100000:3.0:1787395207.988914:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+32:14490:x1874219304608256:12345-192.168.203.16@tcp:101:bash.0 Request processed in 263us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395207.988933:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 42 00000100:00100000:0.0:1787395208.001609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.002360:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608384 00000100:00100000:2.0:1787395208.002375:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608384 00000100:00100000:2.0:1787395208.002458:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:2.0:1787395208.002472:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+32:14490:x1874219304608384:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1787395208.002500:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395208.002735:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95d1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26ec expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.002886:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.002903:0:14133:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 33 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.002913:0:14133:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.002954:0:14133:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 33 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.002969:0:14133:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 33 pid: 14131 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395208.002986:0:14133:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14133:1874219323462528:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395208.003108:0:14133:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787395208.007028:0:14133:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14133:1874219323462528:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395208.007068:0:14133:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.009952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.010996:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608512 00000100:00100000:2.0:1787395208.011011:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608512 00010000:00010000:2.0:1787395208.011067:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 34 pid: 14131 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395208.011135:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787395208.011145:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+34:2363:x1874219304608512:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787395208.011166:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395208.011174:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 34 pid: 14131 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.011189:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 34 pid: 14131 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.011225:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95b5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26de expref: 34 pid: 14131 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.011247:0:14118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395208.011252:0:14118:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.011264:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.011293:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.012166:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395208.012345:0:14133:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.012358:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395208.012432:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787395208.012437:0:14133:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787395208.012465:0:14133:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.012513:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a95d1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26ec expref: 34 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.012534:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26ec expref: 33 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.012552:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:2.0:1787395208.012556:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787395208.012560:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039a00, rc 0) 00000100:00100000:3.0:1787395208.012865:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+33:2363:x1874219304608512:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 1718us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.012877:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1787395208.013385:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+32:14490:x1874219304608384:12345-192.168.203.16@tcp:101:bash.0 Request processed in 10913us (11786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395208.013394:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 43 00000100:00100000:3.0:1787395208.020564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395208.020705:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608768 00000100:00100000:0.0:1787395208.020716:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608768 00000100:00100000:0.0:1787395208.020798:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1787395208.020809:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+32:14490:x1874219304608768:12345-192.168.203.16@tcp:103:bash.0 00010000:00010000:0.0:1787395208.020826:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787395208.020856:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a95d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26ec expref: 32 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.020881:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a95ca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26e5 expref: 31 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.020894:0:14117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b318517200) 00010000:00010000:0.0:1787395208.020907:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787395208.020980:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+30:14490:x1874219304608768:12345-192.168.203.16@tcp:103:bash.0 Request processed in 174us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395208.020989:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:1.0:1787395208.024372:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.024536:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304608896 00000100:00100000:2.0:1787395208.024561:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304608896 00000100:00100000:2.0:1787395208.024631:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:2.0:1787395208.024660:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+30:14490:x1874219304608896:12345-192.168.203.16@tcp:58:bash.0 00010000:00010000:2.0:1787395208.024805:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.024826:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.024840:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787395208.027927:0:14132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787395208.028689:0:14132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787395208.029178:0:14132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787395208.030027:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+30:14490:x1874219304608896:12345-192.168.203.16@tcp:58:bash.0 Request processed in 5357us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395208.030045:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 44 00000100:00100000:1.0:1787395208.033420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.033571:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609024 00000100:00100000:3.0:1787395208.033584:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609024 00000100:00100000:3.0:1787395208.033659:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 45 00000100:00100000:3.0:1787395208.033671:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+30:14490:x1874219304609024:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395208.033698:0:15908:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395208.033722:0:15908:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26f3 expref: -99 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033809:0:15908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033821:0:15908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 31 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033844:0:15908:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033859:0:15908:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 31 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033875:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:3.0:1787395208.033895:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787395208.033899:0:15908:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 31 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.033907:0:15908:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55ce00, rc 0) 00000100:00100000:3.0:1787395208.033991:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+31:14490:x1874219304609024:12345-192.168.203.16@tcp:101:bash.0 Request processed in 322us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.034000:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 45 00010000:00010000:1.0:1787395208.146713:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787395208.361932:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:0.0:1787395208.362079:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:0.0:1787395208.362100:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1787395208.362136:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1787395208.467515:0:14164:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787395208.467526:0:14164:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787395208.467567:0:14164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787395208.467574:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787395208.467689:0:14164:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14164:1874219323462656:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395208.467802:0:14164:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787395208.474367:0:14164:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116d500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14164:1874219323462656:192.168.203.16@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787395208.491157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.491513:0:14142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609152 00000100:00100000:3.0:1787395208.491522:0:14142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609152 00000100:00100000:1.0:1787395208.491695:0:14143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787395208.491708:0:14143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609152:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.491785:0:14143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609152:12345-192.168.203.16@tcp:900:lhsmtool_posix.0 Request processed in 80us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.491795:0:14143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1787395208.501774:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395208.501874:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609280 00000100:00100000:0.0:1787395208.501884:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609280 00000100:00100000:0.0:1787395208.501945:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:0.0:1787395208.501965:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609280:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787395208.502001:0:14131:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787395208.503327:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609280:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 1356us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395208.503338:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 46 00000100:00100000:3.0:1787395208.514250:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.514943:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609408 00000100:00100000:1.0:1787395208.514968:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609408 00000100:00100000:1.0:1787395208.515050:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:1.0:1787395208.515176:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609408:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.515285:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.515930:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.515958:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518245:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518270:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518284:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518349:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518358:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.518364:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787395208.519020:0:15908:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787395208.519025:0:15908:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787395208.519039:0:15908:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519051:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519056:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519060:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519080:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395208.519083:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519088:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519097:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:1.0:1787395208.519099:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395208.519103:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519109:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a95ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519138:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519145:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519151:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519156:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339129600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395208.519159:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519164:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519182:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa0b318517800) 00010000:00010000:1.0:1787395208.519185:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395208.519188:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519193:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a95f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519210:0:15908:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519215:0:15908:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519221:0:15908:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519225:0:15908:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395208.519228:0:15908:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519233:0:15908:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519239:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:1.0:1787395208.519241:0:15908:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787395208.519244:0:15908:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.519249:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a95fb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.519509:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609408:12345-192.168.203.16@tcp:34:lhsmtool_posix.0 Request processed in 4333us (5266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.519528:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 47 00000100:00100000:1.0:1787395208.532303:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.532744:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609664 00000100:00100000:2.0:1787395208.532757:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609664 00000100:00100000:2.0:1787395208.532840:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:2.0:1787395208.532853:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+10:14492:x1874219304609664:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395208.532883:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395208.532910:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9602 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc26fa expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533063:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533081:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533126:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395208.533142:0:14132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787395208.533570:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533580:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533588:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533594:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.533599:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533608:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533623:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395208.533627:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787395208.533633:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533640:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a9609 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533698:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9602 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26fa expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533722:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa0b318946c00) 00010000:00010000:2.0:1787395208.533725:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395208.533730:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9602 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26fa expref: 12 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.533741:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038a00, rc 0) 00000100:00100000:2.0:1787395208.534709:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14492:x1874219304609664:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 1851us (2410us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787395208.534723:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 48 00000100:00100000:0.0:1787395208.548378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.548554:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304609792 00000100:00100000:2.0:1787395208.548569:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304609792 00000100:00100000:2.0:1787395208.548650:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:2.0:1787395208.548663:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14492:x1874219304609792:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787395208.548711:0:14133:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787395208.548863:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14492:x1874219304609792:12345-192.168.203.16@tcp:53:lhsmtool_posix.0 Request processed in 202us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395208.548874:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 49 00000100:00100000:3.0:1787395208.556766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.565487:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610048 00000100:00100000:2.0:1787395208.565508:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610048 00000100:00100000:2.0:1787395208.565605:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:2.0:1787395208.565619:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+11:14492:x1874219304610048:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395208.565647:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395208.565675:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9617 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2701 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787395208.585937:0:14132:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1787395208.585959:0:14132:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787395208.586178:0:14132:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787395208.593673:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a961e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.593698:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a961e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.593710:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a961e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.593819:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038a00/0xedbabbe2e89a9617 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2701 expref: 14 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.593841:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a961e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2701 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.593872:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b308bf3900) 00010000:00010000:3.0:1787395208.593875:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787395208.593878:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55c200, rc 0) 00000100:00100000:3.0:1787395208.593950:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304610048:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 28333us (37198us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787395208.593959:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 50 00000100:00100000:0.0:1787395208.598443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.598718:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610304 00000100:00100000:2.0:1787395208.598727:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610304 00000100:00100000:2.0:1787395208.598788:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:2.0:1787395208.598797:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304610304:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787395208.598854:0:14133:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787395208.598881:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a961e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2701 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598898:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b308bf3900) 00010000:00010000:2.0:1787395208.598908:0:14133:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787395208.598931:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598943:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598953:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598969:0:14133:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598976:0:14133:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.598989:0:14133:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601649:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601905:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601913:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601919:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336038c00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.601923:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601931:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601947:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:2.0:1787395208.601950:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395208.601955:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601960:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336038c00/0xedbabbe2e89a962c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601975:0:14133:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601981:0:14133:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601986:0:14133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.601990:0:14133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.602001:0:14133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.602007:0:14133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.602015:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6fd8e24f (ffffa0b3220dcd00) 00010000:00010000:2.0:1787395208.602018:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395208.602021:0:14133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.602027:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039a00/0xedbabbe2e89a9633 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6fd8e24f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14133 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395208.603857:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+12:14492:x1874219304610304:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 5041us (5406us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787395208.603869:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 51 00000100:00100000:0.0:1787395208.622564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.622681:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610432 00000100:00100000:1.0:1787395208.622692:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610432 00000100:00100000:1.0:1787395208.622754:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:1.0:1787395208.622765:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+12:14492:x1874219304610432:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.622785:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395208.622808:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a963a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2708 expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622844:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a9641 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622857:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a9641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622868:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a9641 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622970:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a963a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2708 expref: 14 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622988:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129600/0xedbabbe2e89a9641 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2708 expref: 13 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.622997:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:1.0:1787395208.623006:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787395208.623011:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129600, rc 0) 00000100:00100000:1.0:1787395208.623072:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304610432:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 310us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.623080:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 52 00000100:00100000:2.0:1787395208.635068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.635975:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610688 00000100:00100000:1.0:1787395208.635988:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610688 00000100:00100000:1.0:1787395208.636054:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 53 00000100:00100000:1.0:1787395208.636064:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304610688:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.636159:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.636176:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.636189:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787395208.636800:0:15908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1787395208.636812:0:15908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 480585505168ns, next at 481585502653ns, rc = 0 00000004:00010000:1.0:1787395208.636901:0:15908:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000026d3bd5a reply state 00000000516c4e79 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.636912:0:15908:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787395208.637009:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+15:14492:x1874219304610688:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 945us (1952us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1787395208.637018:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 53 00010000:00010000:2.0:1787395208.641511:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.641525:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:2.0:1787395208.641531:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.641539:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.641545:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128a00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.641550:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.641558:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.641593:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:2.0:1787395208.641596:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787395208.641602:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.641609:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339128a00/0xedbabbe2e89a9648 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.642387:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610816 00000100:00100000:1.0:1787395208.642399:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610816 00000100:00100000:1.0:1787395208.642519:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:1.0:1787395208.642530:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+14:14492:x1874219304610816:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.642553:0:14131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395208.642570:0:14131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc270f expref: -99 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.642625:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.642640:0:14131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.642659:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:1.0:1787395208.642662:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395208.642665:0:14131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339129e00, rc 0) 00000100:00100000:1.0:1787395208.642728:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+15:14492:x1874219304610816:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 200us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.642735:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 54 00000100:00100000:0.0:1787395208.649406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.649670:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304610944 00000100:00100000:1.0:1787395208.649688:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304610944 00000100:00080000:0.0:1787395208.649741:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787395208.649750:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:1.0:1787395208.649761:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2364:x1874219304610944:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.650032:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2364:x1874219304610944:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 273us (637us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787395208.650038:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395208.666505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.669214:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304611200 00000100:00100000:1.0:1787395208.669253:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304611200 00000100:00100000:1.0:1787395208.669374:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:1.0:1787395208.669386:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+15:14492:x1874219304611200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.669617:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14492:x1874219304611200:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 233us (3127us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787395208.669626:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:0.0:1787395208.675546:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.676794:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304611456 00000100:00100000:1.0:1787395208.676808:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304611456 00000100:00100000:1.0:1787395208.676886:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:1.0:1787395208.676897:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14492:x1874219304611456:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.677025:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14492:x1874219304611456:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 129us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.677033:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 55 00000100:00100000:0.0:1787395208.680530:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.680618:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304611584 00000100:00100000:3.0:1787395208.680628:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304611584 00000100:00100000:3.0:1787395208.680687:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787395208.680697:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+16:14492:x1874219304611584:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787395208.680718:0:14132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395208.680738:0:14132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9656 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2716 expref: -99 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680809:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680822:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680832:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787395208.680866:0:14132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787395208.680883:0:14132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680908:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9656 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2716 expref: 18 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680945:0:14132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2716 expref: 17 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.680954:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:3.0:1787395208.680957:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787395208.680961:0:14132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55cc00, rc 0) 00000100:00100000:3.0:1787395208.681020:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304611584:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 325us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.681027:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 56 00000100:00100000:3.0:1787395208.687297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.688418:0:14769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304611712 00000100:00100000:1.0:1787395208.688430:0:14769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304611712 00000100:00100000:1.0:1787395208.688500:0:14769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1787395208.688509:0:14769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+6:2364:x1874219304611712:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.688527:0:14769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787395208.688549:0:14769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc271d expref: -99 pid: 14769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787395208.688574:0:14769:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a897c88, blocks: 0x1 00010000:00010000:1.0:1787395208.688595:0:14769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787395208.688599:0:14769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395208.688609:0:14769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 7 pid: 14769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.688651:0:14769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 7 pid: 14769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.688664:0:14769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b339128200, rc 0) 00000100:00100000:1.0:1787395208.688722:0:14769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2364:x1874219304611712:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 214us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.688729:0:14769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:0.0:1787395208.696704:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.697159:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304611968 00000100:00100000:1.0:1787395208.697173:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304611968 00000100:00100000:1.0:1787395208.697268:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:1.0:1787395208.697279:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304611968:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.697481:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304611968:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 202us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.697490:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 57 00000100:00100000:0.0:1787395208.703675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.703784:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612096 00000100:00100000:3.0:1787395208.703798:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612096 00000100:00100000:3.0:1787395208.703883:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:3.0:1787395208.703895:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304612096:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787395208.842331:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1787395208.842354:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787395208.842595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787395208.842627:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b34116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323462784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787395208.842727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395208.842839:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323462784 00000100:00100000:0.0:1787395208.842850:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323462784 00000100:00100000:0.0:1787395208.842918:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787395208.842930:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1874219323462784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787395208.843175:0:16260:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787395208.843193:0:16260:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787395208.843195:0:16260:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787395208.843198:0:16260:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787395208 -> 1787395208 00002000:00010000:0.0:1787395208.843200:0:16260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787395208.843269:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1874219323462784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (540us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787395208.843277:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1787395208.843363:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa0b34116ce00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787395208.843371:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b34116ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1874219323462784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787395208.845903:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304612096:12345-192.168.203.16@tcp:44:lhsmtool_posix.0 Request processed in 141345us (141575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.845922:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 58 00000100:00100000:3.0:1787395208.847869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.848541:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612224 00000100:00100000:1.0:1787395208.848558:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612224 00000100:00100000:1.0:1787395208.848633:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:1.0:1787395208.848643:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2363:x1874219304612224:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787395208.848813:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2363:x1874219304612224:12345-192.168.203.16@tcp:16:lhsmtool_posix.0 Request processed in 171us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.848822:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:0.0:1787395208.853212:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.853953:0:15908:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612480 00000100:00100000:1.0:1787395208.853975:0:15908:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612480 00000100:00100000:1.0:1787395208.854075:0:15908:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 59 00000100:00100000:1.0:1787395208.854089:0:15908:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304612480:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.854179:0:15908:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395208.854226:0:15908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a965d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2716 expref: 13 pid: 14132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.854429:0:15908:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:1.0:1787395208.854437:0:15908:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787395208.854639:0:15908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.854655:0:15908:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.854668:0:15908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787395208.856007:0:15908:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049d63905 reply state 0000000049d907d0 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.856024:0:15908:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787395208.856203:0:15908:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd992ac3-06c5-4038-92aa-c3202e68354d+14:14492:x1874219304612480:12345-192.168.203.16@tcp:36:lhsmtool_posix.0 Request processed in 2113us (2998us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1787395208.856215:0:15908:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 59 00010000:00010000:2.0:1787395208.858849:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.858868:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.858876:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.858882:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341011000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.858887:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.858895:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.858911:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:2.0:1787395208.858914:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395208.858919:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.859046:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341011000/0xedbabbe2e89a966b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15908 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.860653:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.861031:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612608 00000100:00100000:2.0:1787395208.861040:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612608 00000100:00100000:2.0:1787395208.861087:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:2.0:1787395208.861093:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+7:14492:x1874219304612608:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787395208.861121:0:14766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395208.861140:0:14766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2724 expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.861172:0:14766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 8 pid: 14769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.861181:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395208.861185:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787395208.861190:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.861222:0:14766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 8 pid: 14769 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.861234:0:14766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 8 pid: 14769 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395208.861249:0:14766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14766:1874219323462912:192.168.203.16@tcp:104: 00000100:00100000:2.0:1787395208.862140:0:14766:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b308ba1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787395208.866235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.866354:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612736 00000100:00100000:1.0:1787395208.866364:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612736 00010000:00010000:1.0:1787395208.866406:0:14116:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 9 pid: 14769 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.866450:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1787395208.866461:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+9:2364:x1874219304612736:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787395208.866476:0:14116:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787395208.866501:0:14116:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 9 pid: 14769 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.866516:0:14116:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 9 pid: 14769 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.866558:0:14116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395208.866562:0:14116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395208.866569:0:14116:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.866579:0:14116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.866616:0:14116:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.866629:0:14116:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14116:1874219323463040:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395208.866721:0:14116:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c22a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787395208.867618:0:14766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc271d expref: 9 pid: 14769 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787395208.867639:0:14766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33677c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:14766:1874219323462912:192.168.203.16@tcp:104: 00010000:00010000:2.0:1787395208.867663:0:14766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.867676:0:14766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336038600, rc 0) 00000100:00100000:2.0:1787395208.867769:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34116dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+8:14492:x1874219304612608:12345-192.168.203.16@tcp:101:lhsmtool_posix.0 Request processed in 6673us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395208.867777:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:1.0:1787395208.868844:0:14116:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14116:1874219323463040:192.168.203.16@tcp:105: 00010000:00010000:1.0:1787395208.868865:0:14116:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787395208.868971:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2364:x1874219304612736:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2511us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.868980:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787395208.870603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395208.870809:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612864 00000100:00100000:0.0:1787395208.870816:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612864 00000100:00100000:0.0:1787395208.870863:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:0.0:1787395208.870872:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2363:x1874219304612864:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787395208.871074:0:16260:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787395208.871077:0:16260:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787395208 00002000:00010000:0.0:1787395208.871078:0:16260:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787395206 00002000:00010000:0.0:1787395208.871080:0:16260:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787395208 -> 1787395208 00002000:00010000:0.0:1787395208.871081:0:16260:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787395208.871144:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2363:x1874219304612864:12345-192.168.203.16@tcp:2:lhsmtool_posix.0 Request processed in 273us (547us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787395208.871152:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 17 00000100:00100000:0.0:1787395208.876078:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.876179:0:14768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304612992 00000100:00100000:1.0:1787395208.876190:0:14768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304612992 00000100:00100000:1.0:1787395208.876303:0:14768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787395208.876346:0:14768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2363:x1874219304612992:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787395208.876393:0:14768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.876427:0:14768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.876436:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787395208.876440:0:14768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787395208.876445:0:14768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.876482:0:14768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.876495:0:14768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 8 pid: 14766 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.876510:0:14768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14768:1874219323463168:192.168.203.16@tcp:104: 00000100:00100000:1.0:1787395208.876596:0:14768:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c22a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787395208.878807:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395208.878937:0:14768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14768:1874219323463168:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395208.879028:0:14768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.879100:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304613120 00000100:00100000:3.0:1787395208.879108:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304613120 00010000:00010000:3.0:1787395208.879155:0:14117:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.879228:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1787395208.879254:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+9:2363:x1874219304613120:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395208.879269:0:14117:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395208.879299:0:14117:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.879350:0:14117:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.879374:0:14117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9f742e/0xedbabbe2e89a9672 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2724 expref: 9 pid: 14766 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.879391:0:14117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395208.879395:0:14117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787395208.879400:0:14117:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.879411:0:14117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.879431:0:14117:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395208.879487:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2363:x1874219304613120:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 234us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.879494:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:0.0:1787395208.879692:0:14768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879702:0:14768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879727:0:14768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879736:0:14768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879757:0:14768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879765:0:14768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b339128200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:0.0:1787395208.879769:0:14768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879778:0:14768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879793:0:14768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.879801:0:14768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079154a30/0xedbabbe2e89a9679 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.879862:0:14768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+7:2363:x1874219304612992:12345-192.168.203.16@tcp:1:lhsmtool_posix.0 Request processed in 3518us (3795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395208.879870:0:14768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:1.0:1787395208.881829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395208.881876:0:14131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304613376 00000100:00100000:0.0:1787395208.881885:0:14131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304613376 00000100:00100000:0.0:1787395208.881942:0:14131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:0.0:1787395208.881960:0:14131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+13:14492:x1874219304613376:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787395208.882047:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882078:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882088:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882384:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882397:0:14131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 14 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882405:0:14131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882438:0:14131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 14 pid: 14131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.882451:0:14131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 14 pid: 14131 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.882465:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323463296:192.168.203.16@tcp:104: 00000100:00100000:0.0:1787395208.882596:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787395208.885285:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323463296:192.168.203.16@tcp:104: 00010000:00010000:0.0:1787395208.885398:0:14131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.886919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.887005:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304613504 00000100:00100000:3.0:1787395208.887013:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304613504 00010000:00010000:3.0:1787395208.887052:0:14118:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.887105:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 16 00000100:00100000:3.0:1787395208.887129:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+15:2363:x1874219304613504:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787395208.887143:0:14118:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787395208.887150:0:14118:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887163:0:14118:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887183:0:14118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b339129e00/0xedbabbe2e89a964f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc270f expref: 15 pid: 14131 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887199:0:14118:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:3.0:1787395208.887204:0:14118:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887213:0:14118:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887220:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.887249:0:14118:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787395208.887300:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+14:2363:x1874219304613504:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.887342:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 16 00010000:00010000:0.0:1787395208.887458:0:14131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787395208.887474:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787395208.887645:0:14131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787395208.887787:0:14131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787395208.887836:0:14131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787395208.887922:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14131:1874219323463424:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787395208.888021:0:14131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395208.888064:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787395208.888288:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323463424 00000100:00100000:1.0:1787395208.888294:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323463424 00000100:00100000:1.0:1787395208.888375:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787395208.888383:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14131:x1874219323463424:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787395208.888458:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14131:x1874219323463424:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395208.888476:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787395208.889056:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14131:1874219323463424:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787395208.890299:0:14131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787395208.890756:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14131:1874219323463552:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787395208.890939:0:14131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787395208.890971:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b2022d00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787395208.891207:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323463552 00000100:00100000:1.0:1787395208.891214:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323463552 00000100:00100000:2.0:1787395208.891837:0:14137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787395208.891843:0:14136:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787395208.891848:0:14137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14131:x1874219323463552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787395208.891855:0:14136:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787395208.892263:0:14137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14131:x1874219323463552:12345-0@lo:1000:mdt00_000.0 Request processed in 418us (1324us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787395208.892270:0:14137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787395208.892568:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b33ff19180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14131:1874219323463552:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787395208.892609:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892620:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892628:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892634:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010e00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395208.892639:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892646:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892662:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:1.0:1787395208.892665:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395208.892669:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892675:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010e00/0xedbabbe2e89a9687 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892707:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892722:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892728:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892732:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039400 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:1.0:1787395208.892735:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892741:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892750:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:1.0:1787395208.892752:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787395208.892759:0:14131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 17 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892770:0:14131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 17 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892779:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 17 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.892811:0:14131:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55ce00/0xedbabbe2e89a95e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc26f3 expref: 17 pid: 15908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787395208.892824:0:14131:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323463680:192.168.203.16@tcp:105: 00000100:00100000:1.0:1787395208.892908:0:14131:0:(client.c:2702:ptlrpc_set_wait()) set ffffa0b327c22780 going to sleep for 11 seconds 00000100:00100000:0.0:1787395208.898899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.899080:0:14131:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14131:1874219323463680:192.168.203.16@tcp:105: 00010000:00010000:2.0:1787395208.899109:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899129:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039400/0xedbabbe2e89a95df lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.899148:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304613632 00010000:00010000:2.0:1787395208.899163:0:14131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.899170:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304613632 00010000:00010000:2.0:1787395208.899191:0:14131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899204:0:14131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899214:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.899222:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00010000:00010000:2.0:1787395208.899222:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899233:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787395208.899235:0:14135:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1787395208.899239:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+18:14490:x1874219304613632:12345-192.168.203.16@tcp:49:bash.0 00000100:00100000:0.0:1787395208.899249:0:14135:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:2.0:1787395208.899250:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b336039600 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.899256:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899263:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899276:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395208.899279:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787395208.899283:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899289:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039600/0xedbabbe2e89a968e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899299:0:14131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899333:0:14131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899339:0:14131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899344:0:14131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b341010000 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:2.0:1787395208.899348:0:14131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899354:0:14131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899364:0:14131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:2.0:1787395208.899367:0:14131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787395208.899370:0:14131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.899376:0:14131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b341010000/0xedbabbe2e89a9680 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.899397:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+18:14490:x1874219304613632:12345-192.168.203.16@tcp:49:bash.0 Request processed in 161us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.899405:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:2.0:1787395208.899742:0:14131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304613376:12345-192.168.203.16@tcp:57:lhsmtool_posix.0 Request processed in 17790us (17921us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787395208.899751:0:14131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000020:00080000:2.0:1787395208.899755:0:14131:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787395208.900238:0:14164:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787395208.900244:0:14164:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787395208.900267:0:14164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787395208.900272:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787395208.904078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.904167:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304613888 00000100:00100000:3.0:1787395208.904177:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304613888 00000100:00100000:3.0:1787395208.904238:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:3.0:1787395208.904249:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+17:14492:x1874219304613888:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787395208.907102:0:14134:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787395208.907221:0:14134:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1787395208.907282:0:14134:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907299:0:14134:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907494:0:14134:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907505:0:14134:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907512:0:14134:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907526:0:14134:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.907613:0:14134:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787395208.907702:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14492:x1874219304613888:12345-192.168.203.16@tcp:35:lhsmtool_posix.0 Request processed in 3452us (3632us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1787395208.907711:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000020:00080000:3.0:1787395208.907717:0:14134:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787395208.907851:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.907973:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304614016 00000100:00100000:3.0:1787395208.907980:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304614016 00000100:00100000:3.0:1787395208.908018:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:3.0:1787395208.908025:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+7:14490:x1874219304614016:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1787395208.908039:0:14766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787395208.908055:0:14766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a969c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc272b expref: -99 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787395208.908075:0:14766:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a897c88, atime: 0x6a897c86, ctime: 0x6a897c88, blocks: 0x1 00010000:00010000:3.0:1787395208.908090:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787395208.908094:0:14766:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787395208.908102:0:14766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc272b expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.908124:0:14766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003b5f482/0xedbabbe2e89a969c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc272b expref: 8 pid: 14766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.908135:0:14766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b33f55d200, rc 0) 00000100:00100000:3.0:1787395208.908164:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+8:14490:x1874219304614016:12345-192.168.203.16@tcp:101:bash.0 Request processed in 139us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.908170:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00010000:00010000:1.0:1787395208.908360:0:14119:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787395208.908366:0:14119:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.908374:0:14119:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc159ce90) 00010000:00010000:1.0:1787395208.908379:0:14119:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.908387:0:14119:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.908399:0:14119:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa0b318517800) 00010000:00010000:1.0:1787395208.908402:0:14119:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787395208.908406:0:14119:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.908411:0:14119:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a9695 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14134 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787395208.908423:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395208.908425:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787395208.908426:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395208.913485:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.913888:0:16265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304614272 00000100:00100000:3.0:1787395208.913897:0:16265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304614272 00000100:00100000:3.0:1787395208.913964:0:16265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:3.0:1787395208.913974:0:16265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+19:14490:x1874219304614272:12345-192.168.203.16@tcp:35:bash.0 00000001:00080000:3.0:1787395208.914245:0:16265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1787395208.914375:0:16265:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1787395208.914495:0:16265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+22:14490:x1874219304614272:12345-192.168.203.16@tcp:35:bash.0 Request processed in 521us (1021us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1787395208.914503:0:16265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000020:00080000:3.0:1787395208.914508:0:16265:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787395208.977218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395208.977338:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304614528 00000100:00100000:2.0:1787395208.977364:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304614528 00000100:00100000:2.0:1787395208.977460:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:2.0:1787395208.977472:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+22:14502:x1874219304614528:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1787395208.977496:0:14133:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787395208.977514:0:14133:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a96a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd7f4f03e7bc2732 expref: -99 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787395208.977797:0:14133:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787395208.977960:0:14133:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a96a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2732 expref: 24 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.977975:0:14133:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa0b3220dc500) 00010000:00010000:2.0:1787395208.977978:0:14133:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787395208.977983:0:14133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b336039e00/0xedbabbe2e89a96a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0xd7f4f03e7bc2732 expref: 24 pid: 14133 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787395208.977997:0:14133:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa0b336039e00, rc 0) 00000100:00100000:2.0:1787395208.978080:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14502:x1874219304614528:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 611us (877us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787395208.978088:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:2.0:1787395208.988420:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1787395208.988477:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304614656 00000100:00100000:3.0:1787395208.988492:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304614656 00000100:00100000:3.0:1787395208.988555:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:3.0:1787395208.988565:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33677c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14502:x1874219304614656:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:3.0:1787395208.988652:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.988669:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.988680:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.988695:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989156:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989164:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989494:0:14132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989504:0:14132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989512:0:14132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787395208.989657:0:14132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989671:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989677:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989684:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989691:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55c200 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395208.989695:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989702:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989722:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa0b3220dcb00) 00010000:00010000:3.0:1787395208.989725:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395208.989729:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989734:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55c200/0xedbabbe2e89a96b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989746:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989751:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989758:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989763:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b33f55cc00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395208.989766:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989772:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989779:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa0b308bf3000) 00010000:00010000:3.0:1787395208.989781:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395208.989784:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989790:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b33f55cc00/0xedbabbe2e89a96b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989813:0:14132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989820:0:14132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989825:0:14132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989830:0:14132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa0b30148ea00 already unused, calling callback (ffffffffc1fd84f0) 00010000:00010000:3.0:1787395208.989833:0:14132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989838:0:14132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989846:0:14132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa0b3220dcf00) 00010000:00010000:3.0:1787395208.989849:0:14132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787395208.989851:0:14132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787395208.989856:0:14132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa0b30148ea00/0xedbabbe2e89a96bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787395208.989935:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33677c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14502:x1874219304614656:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1369us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395208.989956:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:3.0:1787395208.991998:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1787395208.992142:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304614912 00000100:00100000:1.0:1787395208.992152:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304614912 00000100:00100000:1.0:1787395208.992210:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:1.0:1787395208.992220:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+23:14502:x1874219304614912:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:1.0:1787395208.992898:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+24:14502:x1874219304614912:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 494us (724us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1787395208.992907:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00010000:00010000:1.0:1787395209.171435:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395209.811257:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323463808:0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395209.811413:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323464320:0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395209.811466:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787395209.811472:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323464192:0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787395209.811558:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323464320 00000100:00100000:2.0:1787395209.811566:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323464320 00000100:00100000:2.0:1787395209.811616:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323464192 00000100:00100000:2.0:1787395209.811620:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323464192 00000100:00100000:2.0:1787395209.811641:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787395209.811649:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323464320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811700:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874219323464320:12345-0@lo:400:kworker.0 Request processed in 52us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395209.811707:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787395209.811723:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787395209.811729:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811757:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874219323464192:12345-0@lo:400:kworker.0 Request processed in 28us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395209.811763:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787395209.811779:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787395209.811808:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874219323464192:0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.811820:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1874219323464320:0@lo:400:kworker.0 00000100:00100000:1.0:1787395209.811906:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323463808 00000100:00100000:1.0:1787395209.811911:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323463808 00000100:00100000:1.0:1787395209.811953:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787395209.811961:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323463808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787395209.812000:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd69c846-0fd6-4b2d-8c27-adaad01fec71+19:3306:x1874219323463808:12345-0@lo:400:kworker.0 Request processed in 40us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395209.812006:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787395209.812189:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b3291a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd69c846-0fd6-4b2d-8c27-adaad01fec71:3306:1874219323463808:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812243:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323464064:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812275:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395209.812358:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323464576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787395209.812382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395209.812398:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787395209.812404:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323463936:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395209.812442:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323464448:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787395209.812493:0:15729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323464064 00000100:00100000:3.0:1787395209.812497:0:15729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323464064 00000100:00100000:3.0:1787395209.812533:0:15729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323463936 00000100:00100000:3.0:1787395209.812536:0:15729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323463936 00000100:00100000:3.0:1787395209.812557:0:15729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787395209.812564:0:15729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812601:0:15729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323464064:12345-0@lo:400:kworker.0 Request processed in 38us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395209.812609:0:15729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787395209.812625:0:15729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787395209.812633:0:15729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812662:0:15729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1874219323463936:12345-0@lo:400:kworker.0 Request processed in 32us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787395209.812667:0:15729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787395209.812687:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787395209.812690:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787395209.812711:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323463936:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.812722:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323464064:0@lo:400:kworker.0 00000100:00100000:1.0:1787395209.812750:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323464448 00000100:00100000:1.0:1787395209.812756:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323464448 00000100:00080000:3.0:1787395209.812773:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787395209.812789:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787395209.812798:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323464448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787395209.812832:0:14770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219323464576 00000100:00100000:2.0:1787395209.812837:0:14770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219323464576 00000100:00100000:1.0:1787395209.812850:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b341008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874219323464448:12345-0@lo:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395209.812857:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787395209.812871:0:14770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787395209.812880:0:14770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323464576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787395209.812920:0:14770:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787395209.812955:0:14770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b34100ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874219323464576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787395209.812968:0:14770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787395209.814696:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1874219323464448:0@lo:400:kworker.0 00000100:00100000:3.0:1787395209.814724:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa0b327e74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1874219323464576:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787395209.939274:0:14164:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787395209.939286:0:14164:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787395209.941054:0:14164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787395209.941532:0:14164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1787395210.196392:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787395210.567246:0:16302:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1787395211.152291:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152477:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152504:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395211.152537:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615296 00000100:00100000:0.0:1787395211.152549:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615296 00000100:00100000:0.0:1787395211.152653:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615808 00000100:00100000:0.0:1787395211.152657:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615808 00000100:00100000:0.0:1787395211.152672:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615424 00000100:00100000:0.0:1787395211.152675:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615424 00000100:00100000:0.0:1787395211.152688:0:16260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615680 00000100:00100000:0.0:1787395211.152690:0:16260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615680 00000100:00100000:0.0:1787395211.152710:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:0.0:1787395211.152722:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2365:x1874219304615296:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395211.152819:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2365:x1874219304615296:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 99us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395211.152827:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 18 00000100:00100000:0.0:1787395211.152846:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:0.0:1787395211.152852:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304615808:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1787395211.152878:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304615808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395211.152884:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 19 00000100:00100000:0.0:1787395211.152896:0:16260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:0.0:1787395211.152902:0:16260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304615424:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395211.153134:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615040 00000100:00100000:1.0:1787395211.153140:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615040 00000100:00100000:1.0:1787395211.153177:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:1.0:1787395211.153184:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33a6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:2365:x1874219304615040:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395211.153212:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33a6c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:af942336-0a41-4b45-b914-6b487ea80ade+13:2365:x1874219304615040:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395211.153218:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:1.0:1787395211.153282:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:1.0:1787395211.153290:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304615680:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395211.153341:0:14766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+5:2365:x1874219304615680:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 52us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395211.153358:0:14766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 21 00000100:00100000:1.0:1787395211.153391:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615552 00000100:00100000:1.0:1787395211.153395:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615552 00000100:00100000:1.0:1787395211.153426:0:14133:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615168 00000100:00100000:1.0:1787395211.153428:0:14133:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615168 00000100:00100000:1.0:1787395211.153452:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:1.0:1787395211.153459:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2365:x1874219304615552:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395211.153489:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78daf99-fc77-40e6-8ec8-3331e3f6c70b+6:2365:x1874219304615552:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395211.153497:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:1.0:1787395211.153507:0:14133:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:1.0:1787395211.153514:0:14133:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b33ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+24:2365:x1874219304615168:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1787395211.153544:0:14133:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd992ac3-06c5-4038-92aa-c3202e68354d+24:2365:x1874219304615168:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787395211.153551:0:14133:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00080000:1.0:1787395211.153587:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787395211.153594:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787395211.153596:0:14127:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787395211.154163:0:16260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b33ff1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd992ac3-06c5-4038-92aa-c3202e68354d+5:2365:x1874219304615424:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787395211.154175:0:16260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 20 00010000:00010000:1.0:1787395211.218513:0:14120:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787395212.173840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1787395212.173938:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1787395212.176508:0:14772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304615936 00000100:00100000:0.0:1787395212.176524:0:14772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304615936 00002000:00100000:0.0:1787395212.176574:0:14772:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffffa0b3291a2300 x1874219304615936/t0(0) o4->bd992ac3-06c5-4038-92aa-c3202e68354d@192.168.203.16@tcp:673/0 lens 504/0 e 0 to 0 dl 1787395223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787395212.176585:0:14772:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b3291a2300 with x1874219304615936 ext(0->8) 00002000:00010000:0.0:1787395212.176610:0:14772:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b3291a2300 00000100:00100000:0.0:1787395212.176643:0:14772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1787395212.176652:0:14772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+8:2363:x1874219304615936:12345-192.168.203.16@tcp:4:bash.0 00000100:00100000:0.0:1787395212.177164:0:14772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa0b3291a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+10:2363:x1874219304615936:12345-192.168.203.16@tcp:4:bash.0 Request processed in 511us (3224us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1787395212.177172:0:14772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00002000:00100000:0.0:1787395212.177178:0:14772:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffffa0b3291a2300 x1874219304615936/t8589934598(0) o4->bd992ac3-06c5-4038-92aa-c3202e68354d@192.168.203.16@tcp:673/0 lens 504/448 e 0 to 0 dl 1787395223 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1787395212.177187:0:14772:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa0b3291a2300 with x1874219304615936 ext(0->8) 00002000:00010000:0.0:1787395212.177191:0:14772:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffffa0b3291a2300 00000100:00100000:1.0:1787395212.180205:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874219304616064 00000100:00100000:1.0:1787395212.180224:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874219304616064 00000100:00100000:1.0:1787395212.180286:0:14766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 20 00000100:00100000:1.0:1787395212.180298:0:14766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa0b3291b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd992ac3-06c5-4038-92aa-c3202e68354d+10:2364:x1874219304616064:12345-192.168.203.16@tcp:16:kworker.0 00010000:00010000:1.0:1787395212.242520:0:14119:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29241 lines, 29241 kept, 0 dropped, 0 bad.